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THE EXISTENCE, MEASUREMENT AND SIGNIFICANCE OF A SPEED 
FACTOR IN THE ABILITIES OF PUBLIC SCHOOL CHILDREN2 
By W. Line and E. Kaplan 
University of Toronto 
I. Introduction 


One of the important controversies in the 
field of mental measurements is concerned 
with whether ordinary tests of intelligence 
are chiefly measures of speed or of power. 
"power" has been defined to some purpose; ob- 
jectively, in terms of the difficulty of test 
items; subjectively, in relation to the com 
plexity of -the thought-processes involved, 
In the case of "speed," the objective defini- 
tion seems fairly clear, in that it refers 
to the time taken to perform a given task. 
Difference of opinion exists, however, with 
regard to the psychological interpretationof 
the term because of its several possible as- 
pects, The study here reported deals with an 
examination of intelligence test scores, with 
a view to seeing if some one aspect of speed 
comes to light. It then proceeds to investi- 
gate that aspect further by means of special=- 
ly-constructed tests, 

II. Historical Review 

The term "speed" has been used in psycho- 
logical literature with various meanings. It 
is not surprising to find, therefore, many 
conflicting statements, As an instance of 
this we may take the opposing views that 
speed is unrelated to intelligence, and that 
speed and intelligence are synonymous as char- 
acteristic of an individual's ability. 

The first view, that speed is unrelated to 
intelligence, is implied in the popular as- 
Sumption that an individual may be slow, yet 
profound, able, and accurate. It is the view 
that speed is either an inherent idiosyncrasy 
which is not of vital importance in most 
walks of life, where "power" is required; or 





it is the result of a particular environmen- 
tal demand, To some extent, criticisms of 
tests of intelligence on the ground that they 
are only tests of speed, mirror the same 

opinion. Researches from which conclusions 
are drawn in support of this view have been 
reported by Highsmith (5) and Walters (11). 

The second view identifies speed with in- 
telligence. To be quick is to be intelli- 
gent, while slowness is synonymous with dull- 
ness, The work of Boring and Peak (2), and 
of Gilbert (3) may be cited as pertinent to 
this conception of speed, Spearman to some 
extent (10) similarly subscribes to the same 
notion, At the same time, however, he has 
differentiated experimentally between an "at- 
titude to or preference for speed" and "speed 
of cognition." The evidence offered by him 
points to the interchangeability of "speed 
of cognition" and “power” (or "goodness") and 
both, he says, are manifestations of g. Bern- 
stein's work (1) corroborates this general 
finding. So, too, Kelley (6) and Hargreaves 
(4) have succeeded in applying the techniques 
of factor-analysis to this field and have ine 
dicated the independence of the two aspects 
of speed here mentioned, Reymert's demon- 
stration (8) of a group-factor in the field 
of reaction times may be likewise in harmony 
with the foregoing. 

The results obtained in the American Army 
experiment, and in some related researches, 
might be illuminated further if interpreted 
along the lines suggested by this factorial 
approach, We refer particularly to the re- 
ports of May and Terman (7), and of Ruch and 





1. Acknowledgment is here made of the generous cooperation of Mr. S. Richardson, and his staff, among 
whom we would mention especially Miss Raymond and Miss Sloan. Without their assistance this study 
would not have been possible. 
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Koerth (9). With this point of view before 
us, the first experiment was conducted. 
III. The First Experiment 

The National Intelligence Test (Form A) 
was given to a class of 44 Senior Fourth pu- 
pils at a Toronto Public School. The direc- 
tions used in giving the test were altered 
from the standardized form only to the degree 
necessary to obtain scores for half-time, 
standard time, and extended time, the latter 
being one and one-half times the standard 
period, A practice score was also obtained 
by using the results of the exercise preced- 
ing every test-proper in the National Scale. 

Selecting from the results only those that 
are of direct interest here we may note that 
all but three subjects increased their scores 
when the time was extended, None, however, 
obtained full marks even with extended time, 
so that no subjects were handicapped in this 
period by the fact of having already com 
pleted the test. In general, the individu- 
als scoring low in the standard time period, 
gained more than those scoring high. Further 
analysis of the results showed that subjects 
obtaining high scores in the half-time-peri- 
od continued to gain more during the second 
half of the standard time, than the low-scor 
ing individuals, The low-scoring individuals 
however, gained more during the extended time 
period, 

It appears that the duller pupils hadnot 
reached their limit to as great a degree as 
had the brighter by the end of the standard 
time; that is, when they were given more time, 
they improved in relation to the brighter 
ones. This my be due to one or more of sev- 
eral things: 

(a) The bright students were doing harder 
problems during the extended time. There- 
fore the points obtained by bright and dull 
were not comparable. This is obviously true, 
Since the test items are arranged approxi- 
mately in order of difficulty. 

(b) The bright students warm up or become 
orientated more speedily than the dull, thus 
giving the dull a disadvantage in short-time 
tests. That this is true seems indicated by 
the fact that the bright students vary from 
the dull students more on the first-half than 
on the second-half time period. This de- 
crease in variability, however, may be due 
to the differing degree of difficulty of the 
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items attacked by the two groups of subjects 
as the test period proceeds, 

(c) The easier material at the beginning 
of test-groups shows differences not so much 
of “intellectual speed" as of speed of an- 
other kind,--an attitude toward, or prefer- 
ence for, speed. When the material gets 
harder, this attitude toward speed sinks in- 
to less importance compared with the diffi- 
culty-speed (thought-speed) asa differen- 
tiating factor. If this were true, a speed 


factor other than g might show itself in 
practice and half-time scores, 
An examination of the correlations given 
in Table I suggests that this latter inter- 
pretation may be warranted: 


TABLE I 


INTERCORRELATIONS BETWEEN SCORES OBTAINED 
UNDER DIFFERENT CONDITIONS OF TESTING 





Extended 
Time 
idinus 
Standard 


second 
Half 


First 
Half 


Prac- 
tice 








Prac- 
tice 


First 
half 


Second 
half 


Extd. 
minus 
Stand- 

ard 


Stand- 
ard 


.53(.07) -23(.09)| -.37(.09) |.51(.08) 


-16(.10)| -.24(.10) | .80(.04) 


-.41(.98) -65(.06) 


-.41 pe 44(.98) 


63 ~.44 - 

















2 
Note:--The Probable Errors are given in Paren- 


theses. 
With so small a group, tetrad analysis can 
be undertaken only with extreme caution. The 
tentative suggestion that the specific corre- 
lation between the abilities represented by 
the practice and the first-half scores is due 
to an attitude toward speed, or alertness, it 
being effective in both. That such a factor 
exists, will be demonstrated more fully in 
the next section. Here it may be added that 
the attitude for speed might conceivably work 
against success in difficult tasks, since 
the tendency would be to pass on to the next ~ 
item as soon as hindrance is felt, and so 
the number of successes in the later section 
of the test would be smaller, 





—_ 
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IV. The Second Experiment 
In the preceding analysis of intelligence 
test scores obtained under different time 
conditions, the suggestion seemed to be war- 
ranted that, with the easier mteriai, speed 
other than speed of thinking playec a part 
‘n the results. This suggestion arose from 
the fact that a group factor appeared when 
two sections of easy tasks were considered, 
It was therefore decided to construct tests 
of very simple material and to give these un- 
der conditions of limited time, so that such 
a speed factor might conceivably be detected 
more surely, and examined in relation to some 
other abilities. 
A. Procedure 
A battery of tests was devised composed 
of the following: 
1. Substitution--numbers for symbols. 
2. Numbers--same and different. 
3. Easy Word Analogies. 
5. Simple Addition, 
6, Words--same and opposite. 
7. Serial Addition, 
The aim in the construction of these tests 
was to keep the items of approximately equal 
difficulty throughout each test, and simple 
enough to be applied to pupils in the Junior 
Third Grade. The purpose was to obtain a 
measure of speed, so that "power" was prac- 
tically excluded by the simplicity of the 
tasks, A dotting test (Test 4) was included 
as ameans of indicating any significant 
change in attitude towards the experiment. 
The material was gathered together and 
submitted to one class of Junior Third pu- 
pils in a preliminary experiment to make sure 
that the mterial was suitable and the in- 
structions definite, Time allotments also 
were judged on the basis of this trial. The 
pupils who acted as subjects at this time 
were not involved in later experimentation. 
“wo groups of Junior Third Pupils were 
used as subjects. These groups were equiva- 
lent as classified on the basis of metal and 
chronological age, I.Q., scholastic attain- 
ments, and behaviour records. The tests were 
given on four consecutive days at the same 
hour of the morning. Group A, tested at 
9:10, took the tests in order, 1, 2, 3, 4,5, 
6, and 7, With Group B, tested at 9:35, the 
order was reversed, As far as possible the 
conditions of motivation were kept constant 
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for the various repetitions and for the two 
groups, by means of the definiteness of the 
instructions and constancy of the examiner. 
The experimental checks used in relation to 
this point will be discussed later, 

The criterion of intelligence was the Pint- 
ner Group Test for Intelligence, FormA, (1932 
edition). The number of subjects for which com 
plete results were obtained was sixty-four, 


B. Results 


1. Reliability of the Tests 
The reliability of the tests (individual- 


ly) was determined by computing the coef- 
ficients of correlation between the combined 
score in the first and third trials as a- 
gainst that in the second and fourth trials. 
The average coefficient thus obtained was 
-91. The actual values are: 





-94(.01 
-90(.02 


Test l 
- 
3 -94(.01 
5 
6 
7 


-96(.01 
-92(.01 
-79(.03, 


2. Existence of Group Factor of "Speed" 
Scores on tests 1, 2, and 7, for the four 


trials were combined and will be referred to 
as speed,; similarly the totals on tests 3, 
5, and 6 are designated speed,. The sum of 
the scores in the even-numbered tests in 
Pintner (g,), and of the odd-numbered tests 
in Pintner (E)» were used in obtaining the 
following tetrad of correlations: 











, Speed) 82 
Speed) -51 05 
6) 31 62 


The significant size of the tetrad difference 
(.30, p.@. .07) indicates the presence of a 
group factor. The division of the speed tests 
into two pools has given an appreciable "spe- 
cific correlation,” or group factor, which 
is additional to g. 

A closer examination of the tests by means 
of their intercorrelations has supported the 
above conclusion, These correlations are rep- 
resented in Table II, see following page. 

From this table an interesting group fac- 
tor appears between Test 5 and 7, This, how- 
ever, is in accordance with the findings of 
several investigators, since both these tests 
are in the field of arithmetic. The only 
other suggestion of overlap among the speed 
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TABLE II TABLE III 
INTERCORRELATICNS BETWEEN THE SEVERAL TESTS AGE AND CORRESPONDING MEAN TOTAL SPEED SCORE 





Pint- Mean 


| 
Tests | 1 | 2 3 5 7 “ner Age Frequency Total Speed Standard 
= 30 (33. 1 ol3 ae -001 Seere — 


Test 1 | 35 |. , 
(. Soh) |; -07) (.08) (.08) | (. (.08) (.08) 9 13 859.85 114.5 


Test 2| .35 | .90 | ll | .43 27 .. 206 | 10 28 827.21 147. 
(.07) | (.02) | (.08)| (.07)| (.08)}(.08) (.08) | 4) 17 773.47 115. 
12 5 782.6 él. 




















Test 3| .30 | .1l | .94| .15 | .25 | .14.. .25 











“399 | ¢ wed (.01) (.08)| (.08)|(.08) (.08) 13 1 692. - 


| 17. | .71 .. .07 


3 15 
(108) (99) | (198)| (.01)| (208) | (.04) (.08) | nis again suggests that the "speed" here 





Test 5 





Test 6| .26 | .23 | .2 .17 | .92 | .16 .. .45 | measured, and intelligence are unrelated, 

(.08) | (.08) | (. 08)| (.08)| (.01)/(.08) (.07) (b) The I.Q.'s of these children 

| op | re} oa _79 .. .16 | Were not available from the results of the 
lc 04) (. 08) | (08) (.08) | Pintner Test, since, although this test isin 

—, its final form, mental age equivalents are 

Note:--The Probable Errors in Parentheses. | only now being determined, We were there- = 

tests appears in the case of the correlation | fore able to use only I.Q.'s that were based ‘a 

between Tests 2 and 5, The tetrad differ- | on a variety of tests (individual and group), i 

ences which include this correlation are not | and that had been obtained at different times. | 

Significant, but are suggestive; they may pos- | Assuming a fair degree of constancy to the 

Ssibly be explained by the fact that both | 1.Q., and that the various intelligence tests 

these tests involve numbers, Apart from these | gave comparable results, the following data 

two possible exceptions, the correlations of | may be quoted as indicative of the relation- 

the table seem to indicate some factor opera- | ship between "speed" and I.Q.: 

tive in the case of all tests, That this 

factor is not g, is indicated by the extreme- Queet Beares Mean I.Q. — 

ly low correlations of the tests with Pintner High Quartile 104.1 (S.D.6.7) 78.9 

Scores, with the possible exceptions of tests Middle 50% 101.6 (S.D.6.5) 10.7 

3 and 6. (Analogies and Word Opposites). | ten Quartile 97.4 (S.D.7.9) 70.5 


These are less mechanical than the other 
tests; if their correlation with g is elimi- Since these children are all in the same 


nated from the correlation that they show | school grade it appears that the younger ones, 
with each other. [r(Test 3 vs, Test 6 elim, | who are, on the whole, more intelligent than 

g) = 16], the equi-proportionality of the the older, manifest a greater degree of alert- 
coefficients is more marked. We may there- ness. A possible cause of this will be dis- 
fore conclude that the tests here used are cussed later. 

related by a common factor other thang. For 4, Relationship Between "Speed" and 


purposes of reference this is designated as | School Marks. 
a speed factor. A composite score representing the school 


3. The Relationship Between Speed and standing of these children was obtained from 
Age, With Children in the Same School Grade, | the teachers. This was based on all impor- 

The following table gives the range of | tant subjects of the school curriculum, Since 
chronological age in the two classrooms test- | the teachers knew their own pupils better 
ed and the mean total speed score correspond- | than those of another class, and since the 
ing to it. This table shows that there is a | groups were judged to be equivalent by the 
definite tendency for the younger children Research Division, the following method of 
to be superior in the speed score. arriving at this composite was adopted: Each 

This result is illuminated by the follow- | teacher reduced the scores representing total 
ing: school standing to a percentage basis. The 
(a) The correlation between speed two distributions thus obtained were newer 
score and intelligence as determined by the | for means and sigmas, 
Pintner Point Score equals .15 (p.e. .08). 





Test 7/ .13 
(£08) | (-08) | (-08) 








iL. 
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The school marks correlated with intelli- 
gence (Pintner Score) to the degree repre- 
sented by the coefficient .45 (p.e. .07). 
The correlation between speed scores and 
school marks was only .17 (p.e. .08). Aver- 
ages showed a slight tendency for the speed 
scores to parallel the school marks; the high 
quartile middle 50 per cent, and low quar- 
tile (speed scores) corresponding to 71.4, 
70.7, 69.4, (school marks) respectively. 

5. The Comparison Between "Speed Scores” 
and "Misdemeanors" 

The records taken by the Research Divi- 
sionl include, for each pupil, the number of 
misdemeanors throughout the year. A misde- 
meanor is defined as any act on the part of 
the child which interfered with classroom 
procedure, For the year 1930-31, the values 
that apply to the several speed divisions of 
the experimental group are as follows: 











Total 
No. of Cases Misdemeanors 
High Quartile 16 63 
Middle 50% 32 158 
Low Quartile 16 82 











It will be seen that the greater frequency 
of misdemeanors is somewhat characteristic of 
the slower pupils, who tend to be, as we have 
seen, (sect. 3) the older pupils with the 
lower I.Q.'S. 

6. Sex Differences 

There do not seem to be any significant 

sex differences in the speed values obtained. 
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Perseveration was negligible (-.03). But the 
following data indicate a trend that might 
prove to be of interest if examined in more 
detail: 


TABLE IV 


TOTAL SPEED SCORES AND MISDEMEANORS FOR 
PERSEVERATION GROUPS 





Basis of 
Persevera- No. of 
tion Cases 
Scores 


Misdemeanors 


Speed 
(Totals) 


Scores 





First 
tile (Low 
Persevera- 
tion) 7 


uar- 


85.9 3 





Middle 50% 14, 65.2 70 

Fourth 
uartile 
High Per- 
severation) 7 











70.4 21 





This table suggests that while the pupils 
who manifest least perseveration tend to be 
among those showing highest speed, the high- 
ly perseverative children are not necessarily 
in the slowest group. In other words, the a- 
lertness here, which manifests itself as speed, 
may overcome to some degree any perseverative 
tendency present for whatever cause, 

8. Increase in Speed Scores in Succes- 
Sive Trials. 


_ The increase in speed scores in successive 
trials is shown below, It will be seen that 
there is a fairly consistent gain from trial 
to trial. 
































TABLE V 
The averages and sigmas for the boys and - 
girls separately are given below: MEAN DOTTING SCORES AND ERRORS FOR EACH TRIAL 
1 2 3 --... 8 
No. of Mean Standard Trial | Mean of Increase Mean Mean 
Cases Total Speed | Deviation Battery of Dotting | Errors 
Score Tests 
5 9 1 177.5 184.97 12.94 
Boys 34 834.76 13 (S.D. 28.4) 
Girls 30 830.4 147 2 193.7 ° 16.2 196.08 12.42 
(S.D. 33.2) 
7. Perseveration and Speed 3 210.9 17.2 197.55 14.16 
For one of the classes, scores obtained on (S_B- 90-8) 
a battery of "Perseveration Tests" were a- 4 225.2 14.3 205.38 | 14.47 
vailable, The correlation between Speed and (S.D. 44.4) 











1. The Research Division here referred to, is engaged in studies concerning the behavior of Public 


School children. This work is conducted b 
for Mental Hygiene, with the cooperation o 
this work, see Batt, E. A., end Blatz, W. E.: 
ogy, (Decenber, 1927 


the Toronto Division of the Canadian National Committee 
the Toronto Board of Education. 
Pedological Seminar and Journal of Genetic Psychol- 


For a description of 
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That the scores obtained will depend to 
some extent upon the degree of motivation in 
each case, is obvious; but evidence regard- 
ing the consistency of motivation is offered 
in the same Table. Colum 4 gives the aver 
age score on the Dotting test, which was 
given as the middle test for each group. It 
was felt that any marked changes in a sub- 
ject's attitude, especially in the direction 
of diminishing interest and keenness, would 
be indicated by his rate of making a series 
of dots. Similarly, a change in attitude in 
the direction of over-keenness would proba- 
bly result in an increase in the number of 
errors in the various speed tests. The av- 
erages for these errors are given in Colum 
5. The dotting averages are interpreted as 
warranting the conclusion that the subjects 
did not appreciably vary in their attempts to 
maintain a maximum speed. The errors simi- 
larly did not indicate any marked changes, 
especially when one recalls the fact that the 
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total score on the fourth trial was greater 
than on earlier trials. An examination of 
the error records for the subjects individu- 
ally showed a marked consistency here in that 
those who made few errors in the first trial 
did likewise in succeeding trials, while those 
who made most errors at first did so through- 
out. In no case was the number of errors 
significantly large. 

The increases from first to fourth trials 
(total scores) were correlated with intelli- 
gence and with speed score Trial One. The 
values obtained were .10 (p.e. .08) and .41 
(p.e. .07), respectively. 

In Table VI, Part A, the increases made by 
the subjects in the first (high) quartile of 
the distribution of Pintner (intelligence) 
Scores are compared with those made by the 
fourth quartile. Similarly for the first 
and fourth quartiles of the first trial (Part 
B), and of the total speed scores (Part C). 


TABLE VI 


INCREASE IN SCORE FOR GROUPS ON BASIS 
OF PINTNER, FIRST TRIAL AND TOTAL SPEED SCORES 








Trial 1 z 


Incr. Incr. 
4 1-2 2-3 





204.13 
(30.5) 


185.00 


A. High Quartile 
(26.8) 


(Pintner) 


240.5 18.5 17.31 


(35.2) 





191.94 
(39.0) 


172.31 


Low Quartile 
(31.7) 


(Pintner) 


218.25 | 19.63 15.29 


(44.2) 





Diff. btw. High 12.69 12.19 


& Low Quartile 








237.2 
(21.7) 


211.3 


High Quartile 
(19.9) 


(Trial One) 





165.4 
(21.0) 


146.4 


Low Quartile 
(11.75) 


(Trial One) 





Diff. btw. High 64.9 


& Low Quartile 














210.5 


. High Quartile 
(24.7) 


(Total Speed) 





| 156.56 
(14.35) 


‘Low Quartile 
(Total Speed) 





Diff. btw. High 51.94 


& Low Quartile 





























Note: 


The (Standard Deviations in parentheses). 
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The fact that the lowest intelligence quar 
tile gain more from Trial One to Trial Two 
than do the highest quartile, (Part A), sug- 
gests that those subjects of greater intelli- 
gence were orientated to the tests more 
quickly than the others. This advantage was 
overcome in succeeding trials. This sugges- 
tion is further substantiated by the fact 
that Trials One, Two, and Three correlate 
with Pintner Scores to the extent .21 (p.e. 
208), 019 (p.e. .08), .12 (poe. 08), re- 
spectively. Parts B and C both show that 
those scoring higher on the speed tests con- 
sistently make more improvement than those 
who score less. These two results are in 
harmony with the correlations between gain 
and speed, and gain and intelligence, given 
earlier. 


CONCLUS IONS 


l. There is evidence that these tests 
measure a factor (here called "speed" or 
"alertness") with a high degree of reliabil- 


ity. 

2. This speed appears to be a factor other 
than g. 

3. The "speed" factor is not related to 
mental age. 


4. There is evidence to show that the 
greater frequency of misdemeanors is some- 
what characteristic of the slower pupils. 

5. Speed or alertness is not related to 
"perseveration" but the development of alert- 
ness appears to overcome high perseveration. 

6. The evidence suggests that "speed" is 
Subject to improvement with practice, and 
that this improvement does not run parallel 
to mental age so much as to speed itself. 

7. There is some evidence that the speed 
here measured is in some degree relative to 
the I.Q. in a classroom situation, since the 
younger children (those with higher I.@.) 
tend to be the most “alert.” This may be 
the result of their competing with older chil- 
dren. The questionable nature of the 1I.Q, 
ratings available, however, makes it impossi- 
ble to be more definite on this point. Fur- 
ther, it is suggested that intensive case 
Studies of individuals are necessary before 
interpretation of this factor is possible. 
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8. It is felt that this speed factor may 
prove to be identified with that mentioned by 
Kelley (6) and by Hargreaves (4). In the 
latter case, since Hargreaves interprets his 
factor as being significant in creative ac- 
tivities, its further exploration might well 
lead to a method of determining the part 
played by it in creative work such as com- 
position, and a teacher's evaluation of com. 
position. In this way a possible contribu- 
tion to education is indicated, 


SUMMARY 


This study examined intelligence test 
scores under different time conditions. The 
degree of gain in scores was relative to the 
difficulty of the material as well as to the 
intelligence of the subjects, and some indi- 
cation was obtained of a group speed factor 
other than speed of thinking, where easy m- 
terial was being employed. An attempt was 
then made to construct tests which depended 
on this group factor more particularly, and 
speed tests of a fairly high degree of re- 
liability were constructed. The factor ite 
self was then examined in relation to age, 
school marks, intelligence, sex, misdemeanors, 
and perseveration; and possible inferences 
for education are suggested. 
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AN EXPERIMENTAL STUDY OF FUNCTIONAL LEARNING 
By A. S. Barr and J. S. Park 
University of Wisconsin 


The purpose of this experiment was to 
study the relative amounts of learning pro- 
cured by subjects employing the so-called di- 
rect and incidental methods of instruction, 
No attempt will be made to define direct and 
incidental instruction since these terms are 
employed with various meanings under differ- 
ent times, places, and conditions. Instead, 
the writers start with two carefully defined 
methods of study which may or may not con- 
stitute direct and incidental instruction ac- 
cording to the reader's definition. The re- 
sults are true only for the subjects, meth- 
ods, materials, conditions, and the learning 
measured in this experiment, 

An attempt will be made to answer the fol- 
lowing questions: 

1. When two equally difficult artificial 
alphabets are studied under the condi- 
tions of this experiment, and the re- 
sults measured by direct recall and 
recognition tests such as those em 
ployed in this investigation, by which 
of the two methods of study employedin 
this investigation, does the pupil make 
the greater gross gain in raw score? 

2. What are the differences in the shapes 
of the learning curves for the two 
methods of study employed in this in- 
vestigation? 

3. What is the practice effect of learn- 
ing by one method, on learning by the 
other? 

4. How do the learning curves for the two 
methods of study compare when practice 
effect is held constant? 

5. What is the relationship between the 
number of symbols practiced, during 
each study period, and the number of 
symbols learned, for each method? 

6. How do the results from the recall test 
and the recognition test agree for the 
two methods of learning? 

7. What is the relationshi~ between the 
number of symbols learned by the indi- 
rect method and the knowledge of the 
content of the material translated? 





8, What is the relationship between the 
number of symbols learned and the in- 
telligence of the subjects? 

9, What differences in attitude, effort, 
and fatigue did the subjects observe 
in the use of the two methods of study? 

Two artificial alphabets were employed as 

the subject mtter of this experiment. In 
order to make the two alphabets of equal dif- 
ficulty, they were constructed through the 
use of squares, circles, angles, triangles, 
etc., upon identical patterns. The two al- 
phabets are given below: 


ALPHABET A 
a, A\; d,Lib c, @3 4, ®; e, (5); f, 3; 
g, AX; h, [2]; 1, 15 1, AG k, @s 1, Os 
m, 2; n, @/; 0,[2]; vp» A\; 2,13]; r» @5 
s, >; t, 45 u,[1]s3 v, Bs wel 4] x G5 
y, 53 2, \y. 

ALPHABET B 
a, @; vo, Ws c, (i); 4,[41; e, @s t, (8); 
g, 1; h,|2); 1, Gl; 3, Ys k. 53 1, A; 
m, \@/3 n, 8; 0, A\; pv» [5]3 a, Ad; r, 4); 
s, 2) t As u Gv, osu, A; x, 2; 
Y> @; Z, \ey. 

Two methods of study were used. By one 
method (A), the direct method, the subjects 
were instructed to concentrate upon the mem- 
orization of the symbols, while by the other 
method (B), the incidental method, the sub- 
jects were instructed to concentrate upon 
the translation of meaningful material, the 


content of which they were to be tested late 
er. The following directions were read to 








10 


the subjects after the practice materials had 
been placed in their hands: 


DIRECTIONS READ TO BOTH GROUPS A AND B 


This is an experiment in learning, and is 
not an intelligence test. The object of the 
experiment is to compare the learning curves 
obtained during the acquisition of an arti- 
ficial alphabet, by two different methods. 
One method, A, is by direct memorization of 
the symbols by purposeful learning, while the 
other method, B, is by incidentally learning 
the symbols while translating meaningful ma- 
terial. The time intervals for each learn- 
ing period will be 9 minutes. The testing 
time will be 10 minutes, divided into three 
tests of 2, 5, and 3 minutes respectively. 
There will be four practice periods, each 
followed by a testing period, e.g. Practice, 
test, practice, test, etc., for four prac- 
tice periods. 


DIRECTIONS READ TO GROUP A (DIRECT) 


When the signal is given you will have 9 
minutes to study an artificial alphabet. 
Start with the letter “a” and write the sym- 
bol for each letter three times on the dot- 
ted line following that letter. Go through 
the entire alphabet. Then turn the page and 
try to recall the symbols from memory. Write 
the symbol for each letter three times. When 
you cannot recall the symbol quickly, turn 
back to page 1 and refer tc the key. Then 
write the symbol three times and put a check 
mark (-“) after the symbol. Do the same for 
each page of the practice booklet. (Each sub- 
ject was provided with 4 practice booklets, 
one to be used during each study period.) 


DIRECTIONS READ TO GROUP B (INCIDENTAL) 


Remove the top page of the pad and place 
it on the bottom of your pad with its left 
margin protruding far enough to permit the 
key to be seen readily for convenient refer- 
ence in translating the practice material. 
Start at the beginning of page 1 and tran- 
scribe every letter into its appropriate sym 
bol. Make no conscious effort to memorize 
the symbols beyond the incidental learning 
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which occurs spontaneously and automatically. 
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The purpose of the experiment is to compare 
the average performance of each group as a 
study of method,and is not a study of individ- 
ual performance. Work as fast as you can, 
for the number of letters translated is to 
be counted as a part of the score to be com- 
pared with the number of letters written by 
the group using the direct method, Start at 
the beginning of each page and go as far as 
you can in the nine minutes allowed. (The 
subjects were provided with appropriate prac- 
tice booklets.) 

Directions similar to those read audibly 
were printed on the cover page of each book- 
let. The following is a sample page of the 
practice material for method B. 


SAMPLE OF PRACTICE MATERIAL 
FROM BOOKLET B 


i churlish 
olellrebuke 
ou sil 


ind 
ca J 
u 


sympathize 


> 
. 


useficurt 
agonizell 


Ooeyee ll Opn @c o il 


lertrean 


n 
1 
u 
r 
a 
x 
Cc 
u 
e 


bility 

cerulean 

ewllS ymmetric 

xious=pernicious 
Words connected by "=" mean the same 
thing; words connected by "|!" are op- 
posites, 

The rotated group plan of experiment was 
adopted. The subjects of this investigation 
were graduate students enrolled in an advance 
course in Experimental Education (Education 
208) at the University of Wisconsin. ‘Two 
groups of twenty-six subjects each were used, 
one group being given the direct method of 
study (A) first, while the other group was 
given the incidental method of instruction 
(B) first. Three weeks later, allowing for 
sufficient time to prevent interference, the 
methods were reversed, and method B was given 
to those who had had method A, and method A 
was given to those subjects who had had meth- 
od B first. In this way each subject served 
as his own control. A retention test was 


g 
a 
e 
q 
e 
r 
i 
u 
q 
n 
r 
e 
s 


w il 


Beni 
Whee 
Suav 
brus 
Frat 
host 
Prol 
Excr 
tran 
Weak 
vigo 
Azur 
Wry= 
Obno 
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given to each group one week after each ex- 
perimental learning period, In making the 
comparisons, the results for the first appli- 
cations of methods A and B, the second appli- 
cations of methods A and B, the first and 
second applications of method A, the first 
and second applications of method B, and the 
combined applications of method A with the 
combined applications of method B, were all 
compared. In this way the effect of the prac- 
tice of having taken the alternate method 
previously could be measured and held con- 
stant. 

Three tests were employed to measure the 
amount of learning secured from the two 


methods of study and the knowledge 
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ll 


of the 


content of the material being translated: 

test 1, a direct recall test of the symbols 
learned; test 2, a matching test of the syn- 
onyms and antonyms translated into the B al- 
phabet; and test 3, a recognition test of 


the symbols learned, 


duced below: 


These tests are repro- 


TEST 1 = DIRECT RECALL 


am ad 


etc., for the entire alphabet, 


TEST 2 = MATCHING TEST 


MATCH THE ITEMS IN THESE COLUMNS WITH 
THOSE IN THE TWO OPPOSITE COLUMNS 


1 Abstemious 21 Juxtaposition 


2 Affluence 22 Knack 
3 Agnostic 23 Levity 
4 Ascititious 24 Maze 
5 Bamboozle 25 Obnoxious 
6 Benign 26 Paean 
7 Breeze 27 Piquant 
8 Buxom 28 Prize 
9 Castigate 29 Prolix 
10 Cerulean 30 Skew 
11 Debility 31 Spry 
12 Educe 32 Subtle 
13 Equivocal 33 Superfluity 
14 Excruciate 34 Unctuous 
15 Exhalation 35 Vanquish 
16 Facetious 36 Vociferate 
17 Fraternize 37 Wicked 
18 Gawky 38 Wheedle 
19 Harangue 39 Zealot 
20 Jocund 40 Zest 


( 
( 
( 
( 
( 
( 
( 
( 
( 
( 
( 
( 
( 
( 
( 
( 
( 
( 
( 
( 
( 


SAME 


) Agile 

) Agonize 

) Azure 

) Bonny 

) Cajole 

) Diffuse 

) Elicit 

) Excrescence 
) Flagellate 
) Frivolity 
) Frugal 

) Hoax 

) Labyrinth 
) Luxury 

) Nefarious 
) Perplexing 
) Pernicious 
) Propinquity 
) Pungent 

) Visionary 
) Zephyr 


TEST 3 = RECOGNITION 
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and so on for the entire list of symbols used, 
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OPPOSITE 


) Believer 
) Blandiloquence 
) Brusque 

) Churlish 

) Dirge 

) Disrelish 

) Exsiccation 
) Forfeiture 
) Frank 

) Germane 

) Graceful 

) Ineptitude 
) Insipid 

) Lugubrious 
) Melancholy 
) Ostracize 

) Panegyrize 
) Succumb 

) Symmetric 

) Tranquilize 
) Vigor 


OW VALI OAY @ 


eLeaodocwabeaadoaodeaatacohbawbeoh«a du aehtoawaaebhad 
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TABLE I A comparison will first be made of the 


om ¢ NUMBER OF LETTERS MEMORIZED DURING gross number of letters learned by the two 
FOUR STUDY PERIODS OF NINE MINUTES EACH, AND THE | methods of study. The pupils employing the 
NUMBER RETAINED AFTER ONE WEEK direct method learned 18.37 out of the 26 in 
—- the alphabet in 36 minutes, and after one 
N mbols l di No. s ols retained 
oO. wae Sma n i oo tlyeen. week could recall 4,68 letters, while the pu- 
— -_ - — pils employing the incidental method learned 
Measures| Correct] Errors Correct | Errors 11.69 letters and retained only 1.58 letters, 
ant OO on en ee The differences are statistically significant. 
Method A |18.37|.78 22 1.20|3.08|.47 | rae Pupils employing the direct method of 
Method B [11.69] .78 17], 1.58] .51 .65 | learning retained approximately 25 per cent 
of the materials learned, while those employ- 
Differ- ' 
phat 6.68/1.10 28 1.58 .80 ing the incidental method retained approxi- 
ao oy sel mately 13 per cent. The differences between 
atse : the error scores are not significant statis- 


tically. 


















































TABLE Il 
A COMPARISON OF THE LEARNING CURVES FOR DIRECT AND INCIDENTAL LEARNING 








No. of correct symbols, as measured by a direct recall test (Test 1) 





Measures | Period Period — Period Retention 
1 2 4 


“x 





: Mean on Mean on Mean om Mean cm Mean cm 
Method A 4.29 46 9.52 63 14.27 -81 18.37 78 4.68 1.20 
Method B 3.83 35 6.83 -49 9.38 71 11.69 78 1.58 51 


Difference 46 -90 | 2.69 | .80 4.89 | 1.08 6.68} 1.10 | 3.10 | 1.58 
Critical Ratio -51 3.37 4.54 6.06 1.96 












































No. of errors as measured by direct recall (Test 1) 





2 3 4 Retention 





kethod A 27 2.10 26 1.71 24 1.48 222 3.05 47 
Method B 1.19 1.44 «20 1.38 3.00 65 





Difference 30 91 3 27 231 10 28 05 -80 
Critical Ratio 2.98 -87 3 06 























No. of letters correct as measured by a recognition test (Test 3) 





1 2 3 4 Retention 





Method A -33 | 7.21 -56 10.65 13.37 -73 | 4.95 277 
Method B -30 | 5.60 38 7.56 10.54 73 | 1.77 41 





Difference -45 | 1.61 67 3.09 2.83 | 1.03 | 3.18 87 
Critical Ratio 2.40 3.29 2.75 3.66 









































No. of errors as measured by a recognition test (Test 3) 





3 4 Retention 





2 
Method A 2.6 2.21 1.73 1.81 4.90 
1.40 


Method B 1.52 1.54 4.0 





Difference -81 21 27 -90 


Critical Ratio 
































'e 
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‘y 
3 a faint negative acceleration from the start, 
becoming more evident by the fourth period. 
ad The differences between the curves becomes 
ee greater with each learning period, the crit- 
y Test 1. ical ratios from the second period on being 
£ Direct Recatt statistically significant. 
j @: There is a considerable difference in fa- 
; e: vor of the second application, in the learn- 
' ?. ing curves for both methods of study. In 
1 5 general, there is, however, a gradual de- 
' ; crease in the difference from the first to 


the fourth study period, indicating that the 
effect of practice is gradually lost as study 
advances, This difference is more marked in 
the case of method A. It would seem from 
these data that the experience of the previ- 
ous application increases the scores for both 
° methods of study, but that this practice ef- 
fect gradually disappears as learning pro- 
gresses. One interesting sidelight is that 
while the advantage is in favor of the sec- 
ond application throughout both series, in 
Figure l. the retention tests, the scores favor the 
first application, 

In order to rule out or hold constant the 
effect of practice in the learning of the 

The learning curve for each method is ap- | artificial alphabet, the mean scores for each 
proximately a straight line, the increments | method were compared within the same appli- 
of learning for each period being approxi- cation, This amounts to treating the experi- 
mately equal, The learning process was not | ment as consisting of two pairs of equivalent 
carried far enough by either method to show groups. While the means for the second ap- 
any leveling off of the curves. The curve plication due to the effect of practice are 
for method A shows the faintest suspicion of | higher throughout the series for both methods 
a positively accelerated curve at the start, | of study than for the first application, the 
the acceleration becoming negative by the differences between the results for the two 
fourth period. The curve for method B shows | methods are practically the same, the critical 
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Recognition 
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. TABLE III 


A COMPARISON OF THE LEARNING CURVES TO DETERMINE THE PRACTICE EFFECT 
OF EACH METHOD OF LEARNING ON THE OTHER 











































Period Period Period Period Retention Total 
Measures 1 2 3 % 

Mean | 0m Mean | om kean om Mean om] Mean cn Mean on 
Method A 
Application 1 /|3.35 51 8.42 .72 | 13.73 | 1.08 | 18.27 | 1.07 | 6.62 | 1.60 | 43.73 | 2.99 
Application 2 |5.23 72 | 10.62 .98 | 14.81 | 1.19 | 16.46 | 1.16 | 1.69 | 1.33 | 48.77 | 3.70 
Difference 1.88 -88 2.20 1.22 1.08 1.61 19 1.58 4.73 2.08 5.04 4.76 
Critical Ratio | 2.13 1.81 67 12 2.27 1.06 
Method B : 
Application 1 [3.90 49 5.92 76 8.54 | 1.08 | 10.50 | 1.21 | 2.53 -68 | 27.96 | 3.37 
Application 2 /| 4.65 45 7.73 -57 | 10.23 -90 | 12.89 «92 27 13 | 35.50 | 2.58 
Difference 1.65 67 1.81 95 1.69 | 1.41 2.39 | 1.52 | 2.26 -69 7.54 | 4.24 
Critical Ratio | 2.46 1.91 1.20 1.57 3.28 1.78 
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ratios being almost identical for the twoap-| critical ratios for the latter are higher 


plications, When compared with the means than for either application alone, due to 
of the two applications combined, the dif- the higher statistical reliability of the 


ferences are practically the same, but the larger rotated group. 
TABLE IV 


A COMPARISON OF THE LEARNING CURVES FOR THE TWO METHODS OF STUDY WHEN THE EF- 
FECT OF PRACTICE IN THE PREVIOUS APPLICATION IS HELD CONSTANT 


Period 
1 





Period Period Retention 
3 4 





Mean om | Mean om) 





Mean | om 


Application 1 
Method A 3.35 51 18.27 6.62 
2.53 


Method B 3.00 
4.09 


Difference 35 
Critical Katio 49 2.35 











‘ Application 2 
Method A 5.23 14.81 1.89 
Method B 4.65 10.23 -27 


Difference -58 4.58 
Critical Ratio -68 3.07 





1.62 
1.21 












































TABLE V 


COMPARISON OF THE AMOUNT LEARNED DURING EACH PERIOD WITH THE AMOUNT OF 
PRACTICE MATERIAL STUDIED DURING THAT PERIOD 


Period Period Period Period 
1 2 3 4 














Measures Mean on Mean cn Mean Con Mean on 





Method A, Application l 

No. Symbols Written 46.23 | 2.00 63.46 
Accumulated Sum 46.23 2.00 216.00 
Correlation with No. 

Symbols Learned 075 109 


Method B, Application 2 
No Symbols written 53.62 16.44 
Accamlated Sum 53.62 258.35 
Correlation with No. 
Symbols Learned 548 -625 


Metb<ed A, two Applica- 
tions Combined No. 

Symbols Written 49.92 7 69.82 
Accumulated Sum 49.92 237.17 
Correlation with No. 

Symbols Learned 442 -362 
Method B, Application 1 | 123.00 150.92 

Accumulated Sum 123.00 526.50 

Correlation with No. 

Symbols Learned -307 324 


Method B, Application a 
No. Symbols Written 126.23 
Accumulated Sum 126.23 
Correlation with No. 
Symbols Learned 337 
Method B, two Applica- 
tions Combined No. 

Symbols Written 124.65 
Accumulated Sum 124.65 
Correlated with No. 
Symbols Learned ~ 352 


















































Paar 
w 2 





JOURNAL OF EXPERIMENTAL EDUCATION 


TABLE V (Continued) 
Correlation of Practice Material A with Practice Material B 


Method A, 


Application 1 Application 2 Two Applications Combined 





Method B, Application l 

Method B, Application 2 444 

Method B, Two Applica- 
tions combined 





753 


2435 
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In order to determine the correlation be- 
tween the number of symbols learned and the 
number of symbols practiced during each study 
period, a count was made of the number of 
symbols written during each study period. 
These are presented in Table V above, The 
relatively low coefficients of correlation 
throughout would seem to indicate that fre- 
quency of repetition alone does not adequate- 
ly account for the learning secured. In 
method A there is a gradual increase in the 
number of symbols written from one period to 
the next throughout the series, while in 
method B there is a decrease in the number 





written during the second period from the 
number written during the first period. This 
would seem to indicate that for method B, af- 
ter the first testing period, the subjects 
began to mentally rehearse the meaning of 
the symbols at the expense of writing them. 
The correlation between the amount of prac-e 
tice material written for methods A and B 
would indicate that there was more in common 
in the writing of the symbols for the two 
methods of study, than between the memoriza- 
tion of the symbols and the writing of them 
by the same method of study. 


TABLE VI 


A COMPARISON OF TWO WAYS OF TESTING (TEST 1, oy TEST 3, RECOGNITION) 
AND THE SAME AMOUNT OF LEARNIN 





Period 
1 


Period 
2 


Period 
3 


Period Retention 
4 





Measures Mean Mean Mean 


hiean 





Method A, Diff. 
between Tests 1 
and 3, Applica- 
tion 1 

Critical Ratio 
Correlation 





Diff. between 
Tests 1 and 3, 
Application 2 
Critical Ratio 
Correlation 





Diff. between 
Tests 1 and 3, 
Combined Ap- 
plications 
Critical Ratio 
Correlation 





Method B, Diff. 
between Test 1 
and 3, Appli- 
cation 1 
Critical Ratio 
Correlation 





Diff. between 

Tests 1 and 3, 
Application 2 

Critical Ratio 
Correlation 





Diff. between 
Tests 1 and 3, 
Combined A ppl. 
Critical Ratio 
Correlation 
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From these data it is apparent that the TABLE VIII 
recall method of testing the learning of an A COMPARISON OF THE INTELLIGENCE OF THE 
artificial alphabet results in higher scores SUBJECTS AND THE AMOUNT LEARNED 
than the recognition method of testing. This Intelligence|Total Test] Cor- 
result is somewhat different than one would 1 relation 
ordinarily expect. It was also thought that Groups Mean | om! Mean| om) rj] o/N 
one form of testing might favor one or the — mee] — 228.00) 17.69/39.25| 3.91] .174].280/12 
other method of study. While the results for arent A, Ap- 
the recall test and method A are higher than | plication 2 (| 233.15) 14.11/55.08/5.11/.214/.265/13 
those for method B, the differences are ap- tron tn My g 
proximately proportional to the means from and 2 combined) 230.68/ 11.23/47.48/3.6z/.191/.193/25 
which they are taken. It would seem that liethod B, Ap- 
both tests measure to a large extent, the nore a 1 |233.15| 14.11/31.23/4.98/ .351|}.243/13 
Ap- 
Same thing, inasmuch as the correlations plication 2 |228.00/17.69|38.67/3.29|.114|.285|1e 
(practically all in the .80's and .90's) be= | Method B, Ap- 
tween these two methods of testing are so plications 1 
& 2 combined [230.68/11.23/34. 31}. . 
high. The recall method gives a smoother ~ 54.00 [5-51}-180 }.197 |85 
and more uniform curve than the recognition 
method of testing. 
TABLE VII 
A COMPARISON OF THE NUMBER OF SYMBOLS LEARNED WITH THE KNOWLEDGE OF THE 
CONTENT OF THE MATERIAL TRANSLATED DURING THE INCIDENTAL LEARNING 
Number of Words Correct 
Period Period Period Period Correla- 
1 2 3 a tion 
Measures Mean om Mean om Mean on Mean om r 
Method B, Application 1 5.11 6.27 8.98 9.12 11.80 8.47 34.81 5.28 503 
Method B, " 2 4.76 5.19 7.88 8.54 10.31 8.42 31.92 3.51 -032 
Difference _— .35 | 1.08 ~20 .58 1.49 .05 2.89 34 
Critical Ratio * * * * * * -46 
Method B, Applications 1 
and 2 Combined 4.91 5.73 7.98 8.83 11.04 8.44 33.37 2.53 -391 
Increment -82 2.25 -85 2.21 
































A matching test was devised for measuring 
the knowledge of the content of the mterial 


translated by method B. The directions for 
method B emphasized concentration upon the 
translation of the text mter‘al, rather 
than the learning of the symbols translated, 
The content of the material to be translated 
was purposely made difficult, in an effort 
to find words not already familiar to the 
subjects, so that the learning measured would 
be true learning. The correlation between 
the number of symbols used and the knowledge 
of the content of the material translated be- 
ing .391 indicates a fairly low relationship. 
This may mean that the material was too dif- 
ficult in nature, or that the subjects con- 
centrated more on the actual transl-tion than 
on the learning of the meaning of the words 
being used, 












The intelligence ratings on the American 
Council Psychological Examinationwere avail- 
able for about half of the entire group only. 
The mean score for one group was 228, which 
fell in the 92™¢ percentile and for the 
other group was 233, which fell in 937° per- 
centile, so that the two groups were approxi- 
mately equal in intelligence as measured by 
the American Council Psychological Examina- 
tion, The correlation between intelligence 
and the learning of the symbols was .191 for 
the direct method of learning, and .120 

for the incidental method, which seems to 
indicate that there is very little if any re- 
lationship between intelligence and the abil- 
ity to master an artificial alphabet under 
the conditions of this experiment. 
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TABLE 1X 


A COMPARISON OF THE EFFECTS ATTITUDE, EFFORT, 
AND FATIGUE ON THE LEAKNING OF AN 
ARTIFICIAL ALPHABET, BY TWO DIFFERENT METHODS 





Attitude Effort Fatigue 





Mean | om | Mean|om/ Meanion 





Method A, 
Application 1 
lkethod A, 
Application 2 


-29 +23 217 


223 220 





37 26 


Difference 
Critical Ratio 





Method B, 
Application 1 
Method B, 
Application 2 





Difference 
Critical Ratio 





Method A, 
Combined 1 & 2 
iethod B, 
Combined 1 & 2 





Difference 
Critical Ratio 


























A further study was made of the relation 
between attitude, effort, and fatigue, and 
the learning by the two methods of study. 
These data are presented in Table IX. The 
differences all appear to be small and not 
Significant statistically. Under the condi- 
tions of this experiment these data would 
seem to indicate: (1) that, the effort put 
into, and the attitude toward the experiment 
were considerably better than average, (3 be- 
ing average on a 5 point scale, 1 being very 
favorable and 5 a very unfavorable attitude, 
1 being great effort and 5 little or no ef- 
fort, 1 no fatigue and 5 much fatigue), but 
that fatigue was greater than average; (2) 
that attitude and effort ranked slightly bet- 
ter for method A than for B, but that fatigue 
was somewhat greater for method B than for 
A; (3) that the attitude was better toward 
the experiment during the second application 
than during the first, for both methods; (4) 
that there was more effort put forth in the 
second application of method A and the first 
application of method B; and (5) that fatigue 
was greater for method A in the second appli- 
cation, and for method B in the first appli- 
cation, 
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SUMMARY AND CONCLUSION 


In conclusion, the data of this experiment 
would seem to indicate that when two equally 
difficult artificial alphabets are learned 
by direct memorization and by incidental 
learning, the following are true: 

1. Direct learning is about 57 per cent 
more efficient than incidental learning in 
the study of two equally difficult artificial 
alphabets, the difference in favor of direct 
learning being 6 times its standard er- 
ror. 

2. There is a very marked difference in 
the general trend of the learning curve for 
each method of study. The differences in the 
two curves, measured after each study period, 
are three or more times their standard error 
for every period beyond the first. 

3. There is a considerable practice effect 
from one method to the other, resulting from 
having studied the equivalent alphabet pre- 
viously. 

-4, When practice effect is held constant, 
the results of this experiment show that di- 
rect memorization is more effective in learn- 
ing an artificial alphabet than incidental 
learning, by 74 per cent for the first appli- 
cation and 43 per cent onthe second ap- 





Barr and Park 


plication, the critical ratios being approx- 
imately 4 in both cases, 

5. There is a moderately low correlation 
(.447 for method A and .214 for B) between 
the number of symbols learned and the number 
of symbols written in practice. 

6. The recall method of testing the learn- 
ing of the alphabets, shows a more consistent 
curve than the recognition method of testing 
for this type of material. 

7. There is a moderately low correlation 
(.391) between the number of symbols learned 
and the knowledge of the content of the m- 
terial translated by the incidental method of 
learning. 

8, There is a very low correlation (.191 
and .120 for methods A and B respectively) 
between the intelligence of the subjects and 
the number of symbols learned by either meth- 
od. 

9, The incidental method of learning an 
artificial alphabet was found to be more 
fatiguing than direct memorization, under the 
conditions of this experiment. 

The reader is again warned that these re- 
sults are true only for the subjects, materi- 
als, tests and conditions of this experiment. 
One of the greatest limitations of the experi- 
ment was probably the absence of a truly in- 
cidental learning situation, 
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THE RELATIVE CONTRIBUTION OF CERTAIN FACTORS TO INDIVIDUAL DIFFERENCES 
IN ARITHMETICAL PROBLEM SOLVING ABILITY} 


By Max D. Engelhart 


The problem of this investigation is to 
determine the relative contributions of in- 
telligence, computation ability, and reading 
ability to individual differences in arith- 


metical problem solving ability. it may be 
restated more precisely as follows: What per 
cents of the variance® of arithmetical prob- 
lem solving ability of fifth-grade pupils as 
measured by Test 1 of the New Stanford Arith- 
metic Test, Form X, are due to variation in 
intelligence as measured by the Otis Self- 
Administering Test of Mental Ability, Inter- 
mediate Examination, Form cC, to variation in 
reading ability as measured by the New Stan- 
ford Reading Test, Form X, and to variation 
in computational ability as measured by Test 
2 of the New Stanford Arithmetic Test, Form 
X? 

This problem is not an academic one. A- 
chievement in a given field is influenced by 
several factors. In planning where the em- 
phasis shall be placed in classroom instruc- 
tion, it is helpful to know to what factors 
attention should be given. For example, if 
it is found that achievement in history is 
significantly affected by achievement in 
reading it may be concluded with considerable 
justification that instructing pupils in the 
reading of history is desirable. Solution 
of the problem stated above should be helpful 
in drawing inferences with respect to the 
types of instruction which are likely to re- 
sult in increased arithmetical problem solv- 
ing achievement. 

The variables in this study are referred 
to frequently as intelligence, reading abil- 
ity, computation ability, and problem solv- 


University of Illinois 





and achievement are used synonymously. More 
precisely the variables are the scores made 
on the tests administered, but it would be 
awkward to use this phraseology consistently. 
The data used in this study are the scores 
of 568 fifth-grade pupils of the Decatur, 
Illinois, Public Schools. Tables I to IV 
give the means, standard deviations, and bas- 
ic correlations, The numbers assigned to the 
variables in Table I are used as symbols 
in the other tables. 


TABLE I 


MEASURES OF CENTRAL TENDENCY 
AND VARIABILITY 














Standard 
Mean Deviation 
1 Problem score 67.3770 14.9325 
2 Intelligence score | 27.8785 10.2860 
3 Computation score 62.8345 8.7045 
4 Reading score 69.4365 12.8145 
5 Chronological age | 127.2682 Mo. | 11.0829 Mo. 








ing ability. Furthermore, the terms ability 


In connection with Table II it may be ob- 
served that the probable errors of these co- 
efficients are sufficiently small in mgni- 
tude to make all of the coefficients signifi- 
cant, The smllest coefficient is more than 
ten times its probable error. The correla- 
tions with chronological age are low since 
the group consisted of pupils in a single 
grade. (See following page for Table II). 

In Table III, following page, the zero 
order coefficients of correlation have been 
corrected for attenuation by means of the 
following formula: 

Tie 


uss Perr 
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com- 


scores and in computation by Mrs. George Curzon, a clerk of the Bureau of Educational Research. 


2. "Variance" is defined as the square of the standard deviation. 


8 
Sithe Relative Influence of Nature and Nurture Upon Mental Development; A Compara- 
of Foster Parent--Foster Child Resemblance and True Parent--True Child Resemblance," The 


of variability, 
Burks, B. S. 
tive Study 


For reasons for using this measure 
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Twenty-Seventh Learbook of the Hetional Societ for the Study of Education, Part I (Bloomington, 
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TABLE 


JOURNAL OF EXPERIMENTAL EDUCATION 


ZERO ORDER COEFFICIENTS OF CORRELATION WITH 
THEIR PROBABLE ERRORS 


Il 





3 





5 





4 





.5821 + .0187 
.4946 + .0214 


















ean fF 








- 5008 + -0212 -.3182 + -0254 
-7878 + .0107 ~.35222 + .0254 
-4378 + .0229 --3013 + .0257 


-.2794 + -0261 











Each of the reliabilities reported in the 
test manuals was made to conform to the vari- 
ability of the group of pupils used in this 
study by means of Kelley's formula for the 
relation between ranges in obtained scores 
and reliability coefficients.1 









TABLE III 
ZERO ORDER COEFFICIENTS CORRECTED FOR 



















ATTENUATION 
2 3 4 5 
l -7019 -8091 -5817 ~.3459 
2 -6926 -9218 ~ -3528 
3 .5983 - 3853 
4 ~ 2986 























In Table IV coefficients are given for the 
correlations between the different variables 
with the variable chronological age held con- 
stant. The ordinary partial correlation for- 
mula for three variables was used with the 
coefficients corrected for attenuation. 

No correlation technique can show the di- 
rection of causation, Which of two or more 
variables are causes and which are effects 
must be determined by logical analysis or by 





















TABLE IV 


COEFFICIENTS CORRECTED FOR ATTENUATION 
AND WITH CHRONOLOGICAL AGE CONSTANT 





4 
-5343 


& 
-6605 


fr} 
- 7806 


















5487 









experiment. In the present study, it is as- 
sumed a priori that problem solving achieve- 
ment is contributed to by the variables in- 
telligence, computation achievement, reading 
achievement, and unknown causes. This seems 
to be a reasonable assumption. 

The coefficient of correlation .6605 is not 
an index of the contribution of intelligence 
to problem solving ability, because the group 
is heterogeneous with respect to computation 
ability and reading ability. The coefficient 
of correlation .7806 is not an index of the 
contribution of computation since the group 
is heterogeneous with respect to intelligence 
and reading ability. The coefficient of cor- 
relation .5343 is not an index of the contri- 
bution of reading ability since the group is 








1. Kelley, T. L. Statistical Method (New York: 
The reported reliability of the 
The reported reliabilit 
probable errors of a pave mi 






hence, Perr = .8340 





Co s= 8.7045. 







corresponding to .872 was estimated as follows: 
sumed to approximate .75. 






The reported reliability of the reading test is .872. 
only for the sub-tests in word meaning and paragraph meaning 12.9 and 14.1, the standard deviation 





The Macmillan Company, 1923), p. 222. 
arithmetic reasoning test is .75 for o=11.7; hence, ry; = .8465 


of the Otis test is .948 for o =18.38 (obtained from the reported 


for Op = 10.2860. 


The reported reliability of the computation test is .86 for o = 14.5; hence Psi = -6115 for 


Since standard deviations are reported 


The correlation between the two sub-tests was as- 


The standard deviation needed was then secured by the formula: 








The relisbility of the chronological ages was 








The resulting o was divided by two since the scores of the two sub-tests are averaged. 


14.1° +2 + .75 + 12.9 + 14.1 
It equals 
assumed to be 1.00. 
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heterogeneous with respect to intelligence 
and computation ability. Partial correlation 
is often used to eliminate such heterogene- 
ity. This technique, however, partials out 
too much when one or both cf the variables 
whose net correlation is to be determinedare 
not merely effects of the variables eliminat- 
ed, or held constant.” For example, in the 
problem of the relative contributions of pa- 
rental intelligence and environment to child 
intelligence the use of partial correlation 
to eliminate or hold constant environment re- 
sults in the elimination of too much. Paren- 
tal intelligence affects environment. When 
environment is partialled out the net corre- 
lation between parentél intelligence and 
child intelligence is too low. When environ 
ment is partialled out, all that part of pa- 
rental intelligence which correlates with ene 
vironment is removed, and this probably con- 
tains a significant proportion of the heredi- 
tary contribution, Partial correlation tech- 
niques are likewise inadequate for the present 
problem since each of the variables intelli- 
gence, computation achievement, and reading 
achievement are both causes and effects of 
each other. The net correlations of each of 
them with problem solving ability, obtained 
by the partial correlation techniques, would 
be too low, For example, when intelligence 
and reading ability are partialled out, all 
that part of computation ability which cor- 
relates with intelligence and reading ability 
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is removed, and this probably contains a sig- 
nificant proportion of the computation abil- 
ity contribution. 

The path coefficient technique provides 
for the measurement of both direct and indi- 
rect influences. Its use involves the cal- 
culation of coefficients of determination.® 
Some of these, when the decimal point is 
moved two places to the right, show the per 
cents of variance of the dependent variable 
which are due to direct influences from the 
several independent variables, or causes, 
Others of the coefficients of determination 
show what are assumed to be the combined, or 
joint, contributions of given pairs of the 
independent variables, over and above the di- 
rect contribution of each, to the variance of 
the dependent variable. When these coeffici- 
ents of determination are separated accord- 
ing to the weights indicated by the coeffici- 
ents of direct determination, the assumed in- 
direct influences of each of the two varia- 
bles of the pair are given. The per cents 
which represent the indirect influences can 
then be combined with the per cents which ine 
dicate the magnitudes of the direct influ- 
ences, Hence, the analysis finally results 
in a per cent for each of the independent 
variables which represents its total contri- 
bution to the variance of the dependent vari- 
able, When these per cents are added to- 
gather they stand for the total contribution 
of all the known independent variables to the 
variance of the dependent variable, 





1. Burks, B. S. "On the Inadequacy of the Partial and Multiple Correlation Technique," Journal of 
ati Pay logy, (November and December, 1926) XVII, 532-40; 625-30. 
rks, a istical Hazards in Nature-Nurture Investigations," v arb 
f » Part 1 (Bloomington, nois;: ¢ School 
Publishing 


~ 
2. The path coefficient technique was contributed by Dr. Sewall Wright of the University of Chicago 
(formerly of the Bureau of Animal Industry, United States Department of Agriculture). 


Wright, Sewall. 
1921), 557-85. 
Wright, Sewall. 


"Correlation anda Causation," 
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efficient of Eaaieetite ako when the decimal point is shifted two places to the right gives the 
per cent of variance in a dependent variable which is due ” an independent variable. 
if X is a cause of Y, 1 open Piette ny: « Payee 
the per cent of the variance of Y¥ which is due to X. 


For Pt ad 
retation of the Coefficient of Correlation, * 


For example, 
2 a coefficient of determination, gives 
or k®, aeves the per cent of vari- 

ee explanation, see: 
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solution of the equations gives the values of 
the path coefficients. The path coefficient 
values are then used in securing the coeffi- 
cients of determination. 


The first step of the path coefficient 
technique, after the intercorrelations be- 
tween the different variables have been com 
puted, is to set up a diagram in which the 
different variables are represented, for ex- 
ample, by numbered rectangles. These rec- 2 
tangles are then connected by arrows repre- 
senting the assumed paths of influence and 
the directions of the influences between the 
variables. The arrows or paths are then 
designated by the symbols of their "path co- 
efficients.” The positions of the rectangles 
and the lengths of the arrows drawn in the 
diagram are without significance. 

A path coefficient (p,,.,) 1s defined as 
the ratio of that part of the standard devi- 
ation of a variable which is due to another 
variable to the total standard deviation of 
the variable. The path coefficient is equal 
to the coefficient of correlation between the 
two variables when only two variables are Figure 1 
being considered, Wright has shown that when Variables and Paths of Influence 
several variables are involved the coeffici- 
ent of correlation between any two of them 
is equal to the path coefficient of the path 
directly connecting them plus the products 



























































The coefficients of determination measur- 
ing the direct influences are secured by 
squaring the path coefficients of the paths 
of the path coefficients of the paths indi- leading directly from each of the independent 
rectly connecting them. For example, refer- | variables to the dependent variable. The fun- 
ring to Figure 1, rz, is equal to d the path | damental equation is: 
of direct connection plus ab, the product of 
the paths a and b indirectly connecting 3 d,.o= Mo 
and 4, Paths leading to and through the de- 
pendent variable are not considered. This 
general theorem provides a basis for writing 


The coefficients of determination measur- 
ing the joint or combined influences are ob- 
a series of simultaneous equations involving | tained by taking twice the product of the two 
the intercorrelations and the path coeffici- | paths from the given pair of independent var- 
ents. Since the intercorrelations are known, | lables to the dependent variable times the 


1. The interested reader should consult the first article by Wright for the derivation of the funda- 
mental equations given here and for a more detailed explanation of the technique of path coeffi- 








cients. The following discussion briefly indicates the origin of d).»5 = pe and d).58 = 2P)-2P)-5 
Tos - The variance of l, Qo)’, is shown by Wright to be equal to 05 +O, + 2090gro, where 2 and 3 
are two independent correlated variables in a system where 1 is the dependent variable. If each of 
these three terms is now divided by oj, the proportion of oy (the variance of 1) which is due to 2 
acting alone, 3 acting alone, and 2 and 3 acting jointly or in combination will be obtained. These 


ratios are the coefficients of determination and we may write: dj}.9 o%E; G}.3 = os" 3 and 
0 oj 3,2 Se 

di.o3 = at ee Tres- Since the path coefficients p).5 and p).g are equal respectively oo and 
1 


o 
§ . 
3,’ substitution yields the following equations: 4dj.29 = Po.p» djs = Pog» and dy.5¢ = 


2P).2 Pr-sT os: 
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coefficient of correlation between the two 
independent variables. The fundamental equa- 


tion is: 


d,.53 = 2P,.2P).2% ps 


The sum of the coefficients of direct de- 
termination plus the sum of the coefficients 
of joint determination is equal to the total 
determination of the variance in the depend- 
ent variable which is due to the known inde- 
pendent variables. If all possible direct 


and joint influences are included the summ- 
tion is equal to unity according to the fun- 
damental equation:1 


Xd). + Ud1.o3 a i 


When all possible causal influences are 
not included the determination of the unknown 
causes may be represented by di.x and the 
general equation becomes: 


> +24, os +4,.,=1 
Id,.9 + Ud ,.5, then equals the total deter- 
mination of the variance of the dependent 
variable by the known independent variables 
and is equal to the coefficient of multiple 
determination, or the square of the coeffi- 
cient of multiple correlation between the de- 
pendent variable and the known independent 
variables.” d,, is the coefficient of non- 
determination and is equal to the square of 
the coefficient of multiple alienation. It 
may also be obtained by calculating the dif- 
ference from unity of the other coefficients 
of determination. 

The final step of the path coefficient 
technique involves the separation of the 
joint influences according to the weights 
indicated by the coefficients of direct de- 
termination, How this is accomplished is il- 
lustrated in the manipulation of the dataof 
this study. 

In Figure 1, the rectangles 1, 2, 3, and4 
represent the variables, problem solving abil- 
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23 
ity, intelligence, computation ability, and 
reading ability as measured by the test 
scores. X represents unknown factors influ- 
encing problem solving ability. The arrows 
represent the assumed directions of the paths 
of influence, The small letters represent 
the path coefficients. Simple letters are 
used rather than the less convenient symbols 
Py.oe Py.g and so on. The following assump- 
tions were made in drawing Figure 1 and in 
writing the simultaneous equations from which 
the values of the path coefficients were ob- 
tained: 

1. It is assumed that intelligence (2) 
contributes directly to variance in problem 
solving ability (1) through path c, and in- 
directly through reading ability (4) and com 
putation ability (3) along paths ae and bf. 

2. It is assumed that computation ability 
(3) contributes directly to variance in prob- 
lem solving ability (1) through path f, and 
indirectly through intelligence (2) and read- 
ing ability (4) through paths be and de, An- 
other assumed indirect influence is along 
path bae through intelligence (2) and read- 
ing ability (4). The influence of computa- 
tion ability on reading ability may, and 
probably is, insignificant, but it seems saf- 
est to include it. 

3. It is assumed that reading ability (4) 
contributes directly to variance in p?'0blem 
solving ability (1) through path e, and in-e 
directly through intelligence (2) and compu- 
tation ability (3) along paths ac and df. An 
other assumed indirect influence is along 
path abf through intelligence (2) and compu- 
tation ability (3). 

4, It is assumed that reading ability and 
intelligence contribute to each other through 
path a, 

5. It is assumed that computation ability 
and intelligence contribute to each other 
through path b. 

6. It is assumed that unknown causes rep- 
resented by X contribute to variance in prob- 
lem solving ability through path v, 





1. Where Idj.2 includes dj.9, dj-g, and other coefficients of determination of this type, and Xd).s5 


includes d),9§ and other coefficients of the same type. 
2. Wright has shown the relation between the techniques of path coefficients and the techniques of 


_ multiple correlation. 
Beta regression coefficient are identical. 


Kelly, E. L. 


Kelley has likewise demonstrated the relation. 


A path coefficient and a 


"The Relationship Between the Techniques of Partial Correlation and Path Coeffi- 


cients," Journal of Educational Psychology, 20:119-24, February, 1929. 
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On the basis of these assumptions the 
writer uses the language of functional vari- 
ation. For example, in stating that an in- 
dependent variable contributes directly and 
indirectly to the variance of a dependent 
variable, he does so on the basis of a priori 
assumptions rather than on the basis of in- 
ferences drawn from the data, 

It would be possible to assume other routes 
through which the influences could pass a- 
mong the independent variables. Including 
these other routes adds to the complexity of 
the solution and, as Heilman points out, the 
computed path coefficient of each independ- 
ent variable with the dependent variable, on 
which the conclusions of this study are based, 
would not be changed. 

In using coefficients of determination to 
measure the variance of a dependent variable 
which is due to an independent variable the 
assumption is made that the independent vari- 
able "contributes itself completely." That 
is to say, the independent variable is notin 
part an effect of the dependent variable, or 
in part an effect of more remote causes af- 
fected by the dependent variable. The influ- 
ence of the dependent variable on an inde- 
pendent variable may be termed a reciprocal 
influence. The possible reciprocal influ- 
ences of problem solving ability on intelli- 
gence as measured and computation ability as 
measured constitute a source of error to the 
conclusions of this study. Practice in prob-=- 
lem solving undoubtedly affords training in 
computation. The Otis Test contains several 
items which are akin to verbal problems in 
arithmetic. Reciprocal influences from the 
dependent variable are not allowed for in the 
path coefficient techniques. We assume, es- 
sentially, that problem sciving ability is 
intelligence plus other abilities. A possi- 
bly equally valid assumption is that intelli- 
gence is inclusive of problem solving abili- 
ty.” or some portion of it. That is to say, 
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intelligence is in part caused by or due to 
problem solving ability. Some support for 
the assumption that problem solving ability 
is intelligence plus other abilities is pro- 
vided by the Spearman Two Factor Theory ac- 
cording to which problem solving ability 
would be analyzed as ¢ + 8, where "g" is con- 
sidered as intelligence. If this theory is 
correct the assumption made in this study is 
justifiable to the extent that intelligence 
as measured is a cause rather than effect, or 
in part an effect, of problem solving abili- 
ty. It should be noted in this connection 
that even if the dependent variable affects 
the independent variables the coefficients of 
determination are acceptable as minimum val- 
ues. Hence, conclusions are not likely to 
overestimate the contributions ascribed to 
the variables intelligence, reading ability, 
anfi computational ability.3 Reciprocal in- 
fluences among the independent variables are 
taken care of in the path coefficient equa- 
tions as written below. 

The following simultaneous equations were 
written on the basis of the assumptions pre- 
viously given. For example, Tio is equal to 
the path coefficient c, representing the path 
of direct connection, plus the product of the 
path coefficients a and e, representing one 
indirect connection, and plus the product of 
the path coefficients b and f representing 
another indirect connection. Other indirect 
connections adf and bde are not included. The 
Simpler equations, neglecting some of these 
indirect connections, ultimately give the 
same results as would be obtained had all 
possible indirect connections been consid- 
ered. It was stated previously that the 
computed path coefficient of each independent 
variable with the dependent variable, on 
which the conclusions of this study are based 
would not be changed.4 





1. Heilman, op. cit., p. 58. 
3. Support for this statement is found in the article by Tryon. 


*; Pe 423-24. 


2. Tryon, op. c 
coefficient of determination in the 


general case where a common factcr contributes unequally to the variance of two variables falls 
somewhere between the limits r® and r, where r represents the correlation between the two variables. 
Hence, r*®, which corresponds to the coefficients of determination used in this study, is the lower 


limit. 


Reciprocal influences may be thought of as due to a common factor which contributes unequal- 


the equations given are identical with those used by Wright for s» problem involving three independ- 
ent variables in a system "in which each variable is connected with every other variable." The pres- 


ent writer has used different symbols and eliminated the parentheses in the equations for the’path 


coefficients. 
indirect connection between the variables. 


These equations differ somewhat from those of Heilman, who includes more paths of 


(Footnote continued) 








lo = 9143 =a 

los = ,6447 =bd 

Pa, = .§487 =—d + ab 

Ti. = +8605 =ce+ae+odf 

Tjz = +7806 =f +be + de + bae 


Tis 6043 —-e +ac + df +abdf 
solution of the equations given above re- 
sulted in the following values for the path 
coefficients: 
29143 
6447 
-5360 
-.0407 
-.2782 
25877 
vi= 25796 
The values of the coefficients of deter- 
mination were secured from the following 
equations based on the path coefficients just 
given. 


mOeAaAod p 
bib nun 


i« = pate, 
d).5g = 2eCrgg = -.2727 
dj.3q = 2efrgq = -.1795 
dyx =v2  =_,.3369 

1.0000 


Since C =P ,.o, f = Py.g the equation 
d).53 = 2cfroz is the same as di.53 = 2Pi-g 
Pi.3%eg3 + The same thing holds for d,,64 and 
Qi.aqe 

The sum of di.2% Gi-zs Gi-4» G)-53 5 G\-5a 
and d,,3q represents the total determination 
of 1 due to factors 2, 3, and 4, The square 
root of this sum (.6641) is equal to ,&8149 
and should equal Ry.o34+ Ry.p34 when calcue 
lated from the coefficients corrected for 
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attenuation with chronological age constant 
was found to be .8149. This indicates the 
accuracy of the computations since the value 
e&149 was secured from two entirely differ- 
ent series of calculations starting with the 
coefficients of correlation given in Table 
IV. 

The coefficients of determination d).2, 
d,.3, and d,., represent the direct influ- 
ences of the causal factors intelligence, 
computation ability, and reading ability. 
The coefficients d,.5g, 4,.5q, and d,.sqgrep- 
resent the joint influences of the causal 
factors. The combined influence of intelli- 
gence and computation ability is represented 
by 4,.g%- Tie combined influence cf intelli- 
gence and reading ability is represented by 
a) .5q- The combined influence of computa- 
tion ability and reading ability is repre- 
sented by d,."q- These two combined influ- 
ences operate negatively, i.e., they tend to 
decrease the variance in problem solving a- 
bility. 

When the combined, or joint, influences 
are separated on the basis of the relative 
weights of the direct influences and the re- 
sults added to the magnitudes of the direct 
influences the variance of problem solving 
ability is attributed to the different inde- 
pendent variables as follows, in terms of 
per cents: 

1. 25.69 per cent of the variance in 
arithmetical problem solving ability is due 
to variation in intelligence as measured, 

2. 42.05 per cent of the variance in 
arithmetical problem solving ability is due 
to variation in computation ability as meas-e 
ured, 





Footnote 4 continued. 


The values listed for path coefficients c, d, 
calculating the coefficients of ee 
e 


closer check between the total of the coeffic 


correlation coefficient obtained in the ordinary 
those corrected for attenuation and with chronological age constant. 


should be rjo.5,5 Tyg.g, and so on. 


nme 


e, and f have been rounded off to four places. In 


they were used to five places in order to insure a 
mts of determination and the square of the mltiple 


The coefficients of correlation used are 


way. 
More precisely the symbols 


. The value of v® was secured by difference from unity of the other coefficients of determination. 
- Separation of joint influences is illustrated as follows for d,.z: 


dy.2 
i a a. a TT 
dy.2 + 4.5 £875 + 3454 
Gi.g 25454 = 
d +33 = -4062 eTs + 13454 = 22175 
a).2 + di.g 


The value .18445 was added to d,.. and the value .2£175 added to d).5. 
the values -.21485 and -.05787 which were combined with d).p9 and dj.4. 
the values -.14664 and -.03286 which were combined with d)., and 4.4. 





Separation of d)-27 gave 
Separation of d,.g% gave 
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3. -1.33 per cent of the variance in 
arithmetical problem solving ability is due 
to variation in reading ability as measured, 
That is to say, increasing variation in read- 
ing ability tends to decrease variation in 
arithmetical problem solving ability. 

4. 33.59 per cent of the variance in 
arithmetical problem solving ability is due 
to the influence of other causes. These caus- 
es may include that which is peculiar to 
problem solving ability over and above in- 
telligence, reading, and computation. They 
may include aspects of intelligence, reading, 
and computation unmeasured by our tests. They 
may include perseverance, interest, and other 
traits or characteristics which affect arith- 
metical problem solving ability. 

The inferences may be drawn from this a- 
nalysis of the variance in arithmetical prob- 
lem solving ability that intelligence and 
computation ability are important factors in 
causing individual differences in problem 
solving ability. Since nothing can be done 
about intelligence, it would seem worthwhile 
to seek improvement in the solving of prob- 
lems by providing instruction and drill in 
computation. It seems justifiable to infer 
that uniform instruction in computation, i. 
e., computation instruction in which all of 
the pupils participate is likely to increase 
individual differences in problem solving 
ability. The analysis does not indicate, 
however, the probable effect of remedial com- 
putation instruction administered to pupils 
who are inferior in problem solving ability. 
Remedial computation instruction administered 
to pupils whose problem solving achievement 
is inferior would in all likelihood tend to 
decrease individual differences in problem 
solving achievement. The achievement of the 
inferior pupils would be raised toward the 
central tendency of the whole group. 

The analysis seems to indicate that gen- 
eral training in reading is likely to have a 
negligible, or possibly slight negative ef- 
fect, on individual differences in problem 
solving achievement. A similar phenomenon 
has been observed in the case of supervised 
Study. The inferior pupils are aided while 
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the superior pupils are handicapped thus de- 
creasing individual differences. It should 
be noted, however, that the reading test used 
measures a general type of reading achieve- 
ment which possibly should not be expected to 
have a significant effect on problem solving 
achievement. It is possible, therefore, that 
variation in the type of reading ability 
which functions in the reading of arithmeti- 
cal problems causes increased variance in 
arithmetical problem solving ability.) Train- 
ing in the reading of arithmetical problems 
may result in increased individual differ- 
ences where this training is administered to 
all the pupils. On the other hand, the ad- 
ministration of such training to the pupils 
who are inferior in arithmetical problem 
solving ability is likely to decrease in- 
dividual differences in that the problem 
solving achievement of the inferior pupils is 
raised towards the central tendency, 

The large amount of variance due to un- 
known causes should stimulate investigation 
of the possibility of other factors in prob- 
lem solving ability. These unknown factors 
should be isolated and their effects meas- 
ured, preferably by experiment. 

It may be pointed out again that this 
study deals essentially with the variables 
intelligence scores, reading scores, compu- 
tation scores, and problem scores. It is 
justified to refer to the traits as such only 
to the extent that the scores used are valid 
measures of the traits. 

It should be noted that the variable chron- 
Ological age was partialled out prior to the 
use of the technique of path coefficients. 
Hence, the conclusions stated above should 
be restricted to fifth-grade pupils of con- 
stant chronological age. Since the group of 
pupils used in this study may not be alto- 
gether typical of fifth-grade pupils in gen- 
eral, the coriclusions stated above are not 
to be regarded as generalizations without 
Qualification, Somewhat different results 
might be secured with a group which is more 
truly representative of fifth-grade pupils in 
general, 





l. The findings of a recent study, in which partial correlations are given, support this conclusion. 
No functional relationship was reported between general reading ability and problem solving abiii- 
ty. A small but significant relationship was reported between arithmetical reading ability and 


problem solving ability. 


B. A. Stevens. "Problem Solving in Arithmetic," Journal of Educational Research, 25, 253-60, 


April-May, 1932. 
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In conclusion the writer wishes to expruss 
his conviction that the path coefficient tech- 
nique should be given wider use in the anal- 
ysis of human abilities. Numerous problems 
suggest themselves. For example, the vari- 


ance of ability to solve problems in chemis- 
try might be analyzed to find out the rela- 
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tive importance of intelligence, arithmeti- 
cal ability, knowledge of chemical formulae 
and equations, interest in chemistry, and so 
on, When the analysis has been completed ex- 
perimentation should be used to determine 
the relative importance of controlled chang- 
es in the factors whose modification is pos- 
sible, 
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AN EXPERIMENTAL ANALYSIS OF READING PERFORMANCE? 


By Oscar F. 


Litterer 


University of Minnesota 


In general, three experimental methods 
have been employed in the analysis of read- 
ing performance: (1) the measurement of per- 
ception or visual apprehension with tachis- 
toscopes; (2) the measurement of eye-move- 
ments by means of direct and indirect obser- 
vation of the eyes in reading; and (3) paper 
and pencil tests constructed and standard- 
ized to measure individual and group perfor- 
mance in reading. 

Few attempts have been made to discover 
the relationship that may be present among 
visual apprehension, eye-movements, and a- 
chievement on reading tests. The purpose of 
this study is to determine what degree of 
relationship exists among these measures of 
reading performance, To be more specific, 
eye-movement records and visual apprehension 
span will be validated as measures of read- 
ing performance with the paper and pencil 
tests as criteria. The relationship between 


span of visual apprehension and eye-movements 
will also be investigated; and since relies 
bility of the techniques used affects di 
rectly the relationships studied, this fac- 
tor will receive special attention. 

The Minnesota eye-movement apparatus, 
described by Tinker (10), was used to obtain 


the photographic eye-movement records. Two 
records of each subject were taken at one 
sitting. Fourteen lines of easy prose were 
read for the first record and fourteen lines 
of more difficult scientific prose for the 
second, Special precautions were employed to 
accustom the subject to the apparatus and to 
acquaint him with the general nature of the 
reading material. The first paragraphs of 
both types of prose were read by the subject 
before he was adjusted in the apparatus; the 
second paragraphs were read while the sub- 
ject was in focus but no record was. taken; 
and, finally, the third paragraphs were read 
for the records. In both the easy and the 
more difficult prose the three paragraphs 
formed connected discourse. 





The subjects were instructed to read for 
an intelligent understanding of the subject 
matter, but not to study the selections. To 
check the comprehension of the material read, 
each subject was required to answer a set of 
questions on both trial and experimental par- 
agraphs., Seventy-one readable records were 
secured for the easy prose and seventy-six 
for the more difficult prose. The fixation 
frequency, the perception time,® and the re- 
gression frequency per line were computed 


from the records. The relative span of ap- 


prehension was derived indirectly by divid- 
ing the number of words in the experimental 
paragraphs by the total fixation frequency. 

The visual apprehension measurements were 
made with a modification of the Dodge Mirror 
Tachistoscope, described by Tinker (9), and 
with a simple exposure apparatus. In the 
former an expocure interval of 100 sigma was 
used, The simple exposure apparatus consist- 
ed of a stand constructed to hold large cards 
of printed material; a shield was used to 
conceal the material from the view of the’ 
subject and was lowered for the exposure. In 
this study, the exposure time was three sec- 
onds. 

The reading material exposed in both ap- 
paratuses consisted of sentences. Those used 
with the Dodge Mirror Tachistoscope were com- 
posed of seven words and were approximately 
three and one-half inches in length; . they 
were typed on smooth paper and pasted on 
strips of white cardboard, Sample: "This 
is my first day of work." The sentences em- 
ployed with the simple exposure apparatus 
consisted of fifteen words and were hand- 
printed in three lines on large strips of 
white cardboard 11 by 28 inches in size, as 
for example: "The boy never stopped running 
nor looked behind him until he got to the 
house." With the Dodge Mirror Tachistoscope 
a@ preliminary series of 12 sentences which 
served to accustom the subject to the appa- 
ratus and method was given from four to seven 





1. Part of a reading investigation done in the Psychological Laboratory, University of Minnesota, 
under the direction of Professor Miles A. Tinker. 
2. Perception time is the pause duration mltiplied by the pause frequency. 
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days before the experimental series of 70. 
With the other apparatus, an experimental 
series of 20 sentences immediately foliowed 
the preliminary series of five. The subjects 
were tested individually with the Dodge Mir- 
ror Tachistoscope, and in groups of 30 to 40 
students each with the simple exposure appa- 
ratus. After the exposure was completed,the 
subject reproduced on paper as many of the 
words as possible. In both techniques, the 


score was computed on the basis of one point | 


for a correct word reproduced in the proper 
order and one-half a point for a correct word 


in a changed order. 


In silent reading, comprehension and speed | 


are the essential variables to be measured, 
In this experiment, comprehension of read- 
ing was measured by the first part, paragraph 
comprehension, of the Iowa Silent Reading 
Test; and speed of reading was measured by 
two speed tests: the Chapman-Cook Speed of 
Reading Test, and the Minnesota Speed of 
Reading Test. 


All subjects who participated in the in- 


vestigation were sophomore psychology stu- 
dents. It was impossible to obtain measure- 


ments of each student on all parts of the 
experiment and, as a result, the number of 
cases range between 49 and 77 in the several 


comparisons, Table I gives the number of 
subjects secured on each of the measures, and 
the averages and standard deviations of the 
scores, 

Since the results of this problem are 
mainly a function of intercorrelations, it 
was essential to secure measures of the re- 
liability. For the eye-movement measures, 
the number of fixations and the perception 
time computed for the first seven lines of 
both selections were correlated against the 
Same measures on the last seven lines of the 
same selection. This method has the advan- 
tage over the odd-even procedure in that each 
seven line units had the same number of words. 
Coefficients derived in this manner indicate 
the reliability for only half of the selec- 
tions read, The reliability of the whole 
Selections were obtained with the Spearman- 
Brow prophesy formula, These coefficients, 
as shown in Table II, are all .90 or above 
with the exception of that for the fixations 
on the more difficult prose (.775). 
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TABLE I 


THE MEANS AND STANDARD DEVIATIONS 
OF THE SCORES 





Measures N HM 








Fixation Frequency on Easy Prose 71 6.00 


Perception Time on Easy Prose 71 
Regression Frequency on Easy 

Prose 71 
Relative Span on Easy Prose 71 


-65 


| Fixation Frequency on Scientific 


Prose 76 

Perception Time on Scientific 
Prose 

hegression Frequency on Scien- 
tific Prose 

helative Span on Scientific 
Prose 

Visual Appre. Scores - 100 
Sigwa exposure 

Visual Appre. Scores - three 
sec. exposure 

Chapman-Cook Speed of Keading 
Test 

lainnesota Speed of Reading Test 

lowa Silent Reading Test 





TABLE II 
RELIABILITY COBFFICIENTS 








S - B Proph- 
esy Formula 


Raw 
Measures r 


Fixation Frequency on 
Easy Prose 

Perception Time on Easy 
Prose 

Fixation Frequency on 
Scientific Prose 

Perception Time on Sci- 
entific Prose 

Visual Appre. Scores - 
100 sigma Exposure 

Visual Appre. Scores - 
three sec. Exposure 

Chapman-Cook Speed of 
Reading Test 

hinnesota Speed of Read- 


ing Test 
Iowa Silent Reading Test 


P.E. 





O01 
201 


-854 _ .02 .921 


-O1 
-00 
201 
. +03 


_ 208 
~ .02 


-03 


-02 
03 


-860 = 
773 _ 





1. These coefficients were taken from previous 
studies (7, 1) wade on comparable groups and 
corrected for the difference in the standard 
deviations by Kelley's (5) formula for sdjust- 
ing reliability coefficients. 


The reliabilities of the visual apprehen- 
sion scores were obtained by correlating the 
scores of the first half of each test with 
those of the second half. The coefficients 
of .967 and .911 imply that the visual appre- 
hension span was measured with much consis- 
tency either by the simple exposure apparatus 
or by the Dodge Mirror Tachistoscope, 
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In the paragraph comprehension test, the 
items in the first and second half are not 
comparable and, therefore, the odd-even meth- 
od was used to obtain the reliability. The 
reliability coefficient of this measure 
proved to be .871 which reveals nearly as 
much consistency as the eye-movement measures 
and the visual apprehension scores, 

One form of the Chapman-Cook Speed of 
Reading Test and the Minnesota Speed of Read- 
ing Test were given, hence the impossibility 
of securing a reliability coefficient. An 
average coefficient for the former was ob- 
tained from Tinker and Paterson's (7) inves- 
tigations, and for the latter from Eurich's 
(1) study. They were corrected for the dif- 
ference in the standard deviations by Kelley's 
(5) forma for adjusting reliability coeffi- 
cients. The coefficients for these tests are 
.755 and .798 which are somewhat lower than 
those obtained on the other measures, They, 
nevertheless, possess sufficient consistency 
for the analysis of group performance, 

Each eye-movement measure for the easy 
prose was correlated with the corresponding 
record for scientific prose to determine the 
agreement of the measures for the different 
types of reading mtter. The four measures, 
consisting of the fixation frequency, the 
perception time, the relative span, and the 
regression frequency, as tabulated in Table 
III, have correlations which show a fair de- 
gree of relationship. The raw correlations 
range from .674 for regression frequency to 
.832 for perception time, The fixation fre- 
quency and the relative span correlated to 
an equal degree (.77) because the same vari- 
eble is involved in both measures, namely, 
the number of fixations. The raw correla- 
tions, with the exception of the one for the 
regression frequency, corrected for attenua- 
ticn, are approximately .91 for the three 
eye-movement measures, Fixation frequency 
and perception time, according to the core 
rected correlations, measure eye-movements 
with the same degree of consistency when the 
errors of measurement are eliminated. Tinker 
(8) has shown that the greater the change in 
type of reading material and the resulting 
reading attitude, the smaller is the corre- 
lation between the eye-movement measures of 
two different selections, This interpreta- 
tion suggests that the two selections usedin 
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this study were read by the subjects with a- 
bout the same attitude, 


TABLE III 


INTERCORRELATIONS ON THE 
SIMILAR MEASURES 








Raw 


Measures r P.E. 





Fixation Frequency on Easy 
Prose vs. Fixation Fre- 
quency on Scientific Prose 

Perception Time on Easy 
Prose vs. Perception Time 
on Scientific Prose 

Regression Frequency on 
Easy Prose vs. Regression 
Frequency on Scientific 
Prose 

Relative Span on Easy Prose 
vs. Relative Span on Sci- 
entific Prose 

Visual Appre. Scores - 100 
sigma exposure vs. Visual 
Appre. Scores - three sec. 
exposure 

Chapman-Cook Speed of Read- 
ing Test vs. Minnesota 
Speed of Heading Test 

Chapman-Cook Speed of: Read- 
ing Test vs. lowa Silent 
Reading Test 

Minnesota Speed of Reading 
Test vs. lowa Silent Read- 
ing Test 540 


-798 .03 


-565 -697 .04 


-06 .648 .05 





The correlation of .570 (corrected for at- 
tenuation, .607) reveals only a moderate re- 
lationship between the two visual apprehen- 


sion tests, The short exposure of 100 sigm 

excluded all eye-movements and made it possi- 
ble to secure a visual apprehension span of 

one fixation. The three second exposure, on 

the other hand, yielded a span involving sev- 
eral fixations. It is evident that the two 

measures of apprehension are not interchange- 
able. 

The Minnesota Speed of Reading Test meas- 
ures rate of reading with more difficult con- 
tent than the Chapman-Cook Test. The former 
was constructed to measure the rate at which 
college students read content comparable to 
their general reading. The Chapman-Cook Test 
was designed to measure the reading rate of 
elementary pupils. This test, however, has 
been widely used as a measure of the reading 
rate on the high school and college level. On 
the college level the comprehension errors in 
the Chapman-Cook are practically zero. The 
correlation between the scores of the two 
speed tests is .620 which is the same as that 
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found by Eurich (1). The coefficient for the 
present data, corrected for attenuation is 
.798. Paragraph comprehension, the first 
part of the Iowa Silent Reading Examination, 
shows a low but significant relationship to 
the two speed of reading tests. The corre- 
lation is .565 with the Chapman-—Cook am .540 
with the Minnesota Speed Test. The coeffi- 
cients corrected for attenuation are .697 and 
648 respectively. 

Further intercorrelations are given in Ta- 
ble IV. The eye-movement measures show a low 
but rather uniform relationship to the visual 





apprehension scores, 


is not very diagnostic of apprehension in the 
more normal situation which involves contin- 
uous reading of related material, 

A series of experiments have been performed 
to determine the importance of perception in 
reading. Gates (2) has interpreted his data 
-—-secured from elementary school subjects— 
to mean that perception is specialized rath- 
er than general, Mueller, cited by Starch, 
(6), with high school students as subjects, 
obtained correlations of .64, .73 and .70 
respectively when the apprehension span for 
unrelated words was correlated against speed, 
comprehension, and speed plus comprehension 


TABLE IV 


INTERCORRELATIONS OF VISUAL APPREHENSION, EYE-MOVEMENTS AND READING 
TEST SCOKES. IN EACH CASE THE COEFFICIENT, CORRECTED FOR 


ATTENUATION, FOLLOWS 


THE RAW COSFFICIENT1 











Visual Visual Appre. Chapman- kinnesota Paragraph 
Appre. 3 sec. Cook Speed Speed of Comprehension 
1000 Expo- Exposure of Keading -— Reading of the Iowa 
sure Test Test Silent Reading 
Raw Atten. Raw Atten. Raw Atten. Raw Atten. Raw Atten. 
Measures r r r r r r r r r r 
1. Fivation Frequency 
on Easy Prose - 437 -.463 -.313 -~.542 - 433 -.519 -.327 -.381 -~.476 -.531 
2. Perception Time on 
Easy Prose -.-343 -.366 -.431 -.474 -.496 -.599 -.285 -.334 -.413 -.464 
3. Relative Span on 
Easy Prose 463 +490 328 358 --- --- --- --- --- --- 


4. Fixation Frequency 
on Scientific Prose -.383 -.442 -.295 -.351 


5. Perception Time on 


Scientific Prose -.326 -.347 -.342 -.375 
6. Relative Span on 

Scientific Prose 356 441 2293 348 
7. Visual Appre. - 100 


o Exposure 
8. Visual Appre. - 3 
sec. Exposure 


-.513 -.671 - 326 -.414 -.450 -.548 
~.460 -.554 -.270 -.316 -.393 -.441 


2513 ~=.600 2549 .625 -512 -558 
0423 =.510 e405 .475 2421 2473 





l. The average probable error is + .06 with range from + .04 to + .08. 


The average correlation is .384 with a range 
from .326 to .4631 between the eye-movement 
measures and the visual apprehension scores 
secured with a 100 sigma exposure. The av- 
erage corrected coefficient is .424 with a 
range from .347 to .490. A similar average 
and range was obtained between the eye-move- 
ment measures and visual apprehension scores 
secured with a three second exposure. The 
average correlation is .333 with a range from 
513 to .431, and an average of .374 with a 
range from .342 to .474 when corrected for 
attenuation. Apparently, apprehension of ma- 
terial exposed for 100 sigma or three seconds 


in reading. When span of related worde was 
substituted for unrelated words, the corre- 
lations were .70, .59 and .69 respectively 
with the same measures. In the present in- 
vestigation college students were employed 
as subjects, and a somewhat lesser relation- 
ship was found between apprehension scores 
and reading test scores. The Chapman-Cook 
correlated .513 with apprehension scores se- 
cured with a 100 sigma exposure and .423with 
a three second exposure. The corrected co- 
efficients are .600 and .510 respectively. 
The Minnesota Speed Test shows practically 





the same relation to the apprehension scores, 





1. It seemed more adequate to ignore signs in averaging these coefficients. 
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The correlations are .549 and .405 respec- 
tively for the 100 sigma and three second 
exposure; and the corrected coefficients are 
.625 and .475 between the same measures. Sim- 
ilar coefficients were obtained when appre- 
hension scores were compared with comprehen- 
sion in reading. The correlations between 
paragraph comprehension and apprehension 
scores secured with 100 sigma and three sec- 
ond exposure are .512 and .421 respectively. 
These correlations corrected for attenuation 
are .558 and .473. These data suggest that 
the span of apprehension plays a less impor- 
tant part in the reading of adult subjects 
than with high school and elementary school 
pupils. ; 

It has been assumed that fixation frequen- 
cy and perception time are good measures of 
speed and comprehension in reading. Gray (3) 
found that the slowest reader made longer 
and more fixations than the most rapid read- 
er. In this investigation, however, the cor- 
relations reveal only a moderate relation- 
ship. The fixation frequency on the easy 
and scientific prose correlated -.433 and 


-.513, and when corrected for attenuation 
-.519 and -.617 with the Chapman-Cook Speed 


of Reading Test. Mueller, cited by Starch, 
(6) found a similar relationship,! namely, a 
coefficient of -.54 between the number of 
fixations and rate of reading. The Minnesota 
Speed of Reading Test shows a slightly small- 
er correlation with fixation frequency. The 
coefficients are -.327 and -.326, and cor- 
rected for attenuation are -.381 and -,414 
respectively with the easy and more difficult 
prose, 

Perception time, according to Tinker (8), 
is the most valid photographic measure of 
rate in reading when all measures are on the 
same reading material. In this experiment, 
both perception time and fixation frequency, 
as measured in reading mterial different 
than that in the reading tests, show approxi- 
mately the same correlation with speed of 
reading. The coefficients are -.285 and 
-.270, and when corrected for attenuation 
-~.334 and -.316 between the easv and more dif- 
ficult prose respectively, and the Minnesota 
Speed of Reading Test. The Chapman-Cook 
Speed of Reading Test correlated somewhat 
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higher with the same photographic measures, 
These correlations of -.496 and -.460 when 
corrected for attenuation are -.599 and 
-,.554, 

Paragraph comprehension, as measured by 
the Iowa Silent Reading Examination, shows a 
fair relationship to the two eye-movement 
measures, The fixation frequency on the 
easy and more difficult prose correlated 
-.476 and .450, and corrected for attenua- 
tion -.531 and -,548 with paragraph compre- 
hension, Mueller, cited by Starch, (6) ob- 
tained between comprehension and fixation 
frequency a correlation of -.49 which is 
Slightly higher. Perception time in this 
study correlated with the same reading test 
-.413 on the easy and -.393 on the more dif- 
ficult prose, The coefficients corrected 
for attenuation are -.464 and -.441l,. Eye- 
movement records, therefore, correlated a- 
bout as well with comprehension as with rate 
in reading. 

Although these intercorrelations when cor- 
rected for attenuation are not raised much 
(average rawr is -.403; average corrected r 
is -.481), as can be observed by a compari- 
son of the raw and corrected coefficients in 
Table IV, the true relationships have some 
Significance. An average corrected coeffi- 
cient of -.473 with a range from -.316 to 
-.671 was obtained between the eye-movements 
and rate of reading. A similar average co- 
efficient of -.496 with a range from -,441 
to -.548 was secured between eye-movements 
and comprehension. One can tentatively con- 
Clude that eye-movements on easy and scien- 
tific prose, and reading tests tend to meas- 
ure somewhat similar reading performance, 


SUMMARY AND CONCLUSION 


1. In this investigation, the attempt was 
made to determine the approximately true re- 
lationship between visual apprehension, eye- 
movements, and achievement on reading tests, 

2. Reliability of the measuring devices 
was given special attention. The measures 
yielded a reliability sufficiently high for 
group comparisons. The eye-movement measuryes 
and the visual apprehension scores, in par- 
ticular, showed a very high degree of inter- 
nal consistency, 





l. Starch lists the correlations as positive but writes in the discussion that the fixation frequency 


per line is probably inversely proportional to the amount apprehended at each fixation. 


They are 


cited as negative in this report to wake them comparable to our correlations. 
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3, Each eye-movement measure showed a high 
correlation between easy and scientific prose, 
indicating that the two paragraphs were not 
read with markedly different attitudes. 

4, Although the visual apprehension scores 
secured by exposure intervals of 100 sigm 
and three seconds show a fair degree of a- 
greement with each other (.607), they are 
not interchangeable. 

5. The scores on the three reading tests: 
the Chapman-Cook Speed of Reading Test, the 
Minnesota Speed of Reading Test, and para- 
graph comprehension intercorrelated to an 
appreciable degree (.648 to .798). 

6. Eye-movements showed only 4 moderate 
relationship with the visual apprehension 
scores (-.342 to -.474). 

7. The correlations, corrected for atten- 
uation, between visual apprehension scores 
and the reading test scores reveal a fair 
degree of relationship (.473 to .625). 

8. Fixation frequency and perception time 
in reading is correlated only moderately 
well with rate and comprehension. 

9, In general, the data justify the con- 
clusion that there is a fairly significant 
but not high relationship among visual appre- 
hension scores, eye=-movements, and achieve- 
ment test scores in reading. 
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A STUDY OF THE RELATIVE AMOUNTS OF TRANSFER 
RESULTING FROM THREE METHODS OF STUDY 
By John B, Cluley 
University of Wisconsin 


The purpose of the investigatio. ceported 
herein is to determine the relative amounts 
of transfer resulting from three methods of 
studying rectangles and triangles. 

The practical utility of most school stud- 
ies has been shown quite conclusively to be 
rather limited and, in most instances, to 
follow the law of diminishing returns. E. L. 
Thorndike sets forth the premise that even a 
small amount of transfer effect may equal in 
importance, after a certain point, the di- 
rect utilities of the school studies.) In 
two very extended investigations he shows 
that the differences in transfer effect re- 
sulting from different school studies is 
small. If transfer, however, depends, as C, 
H. Judd says it does, upon the extent to 
which the information is generalized, then it 
is not unreasonable to believe that the meth- 
od of study may have quite as much to do 
with the amount of transfer as does the sub- 
ject matter studied. Several recent investi- 
gations seem to indicate this possibility. 
Procedure and Materials 

The equivalent-groups method of experi- 
mentation was used in the study. Three groups 
of pupils, 95 cases in each group, were ob- 
tained from the sixth and seventh grades of 
four cities in southern Wisconsin. The pu- 
pils were matched on the basis of mental age 
and intelligence quotient, as measured by the 
Detroit Alpha Intelligence Test, Form M, 

A fixed time-schedule was followed in each 
room to avoid irregularity and interruptions 
of work, With the cooperation of the teach- 
er in charge of the room, the investigator 
made out a schedule before any of the work 
was done. The schedule was followed without 
variation in every room where work was car- 





ried on. A copy of a schedule used in one 
of the rooms is given for illustration. 


Time-Schedule Used in a Stoughton, Wisconsin, 
Sixth Grade. 





Monday, Oct. 19 9:00-9:45 Detroit Alpha Int. 
Test 
Tuesday, Oct. 9:00-9:20 Arithmetic Pretest 





Monday, Oct. 9:00-9:30 Study of rectangles 
Tuesday, Oct. 9:00-9:30 Study of triangles 
Wednesday, Oct. 9:00-9:20 Arith. Final Test 





Wednesday, Nov. 9:00-9:20 Arith. Retention 
Test 











The subject matter of the investigation 
dealt with rectangles and triangles. Three 


| phases of the material were considered: (1) 


general information; (2) recognition of the 
forms; and (3) computation of areas. The same 
subject matter content was presented by three 


| different methods of instruction. The in- 


struction was made uniform for all pupils by 
using mimeographed materials, The three meth- 
ods, usually spoken of in the tables as meth- 
ods A, B and C, are describded in detail. 

Method A was planned to represent a very 
formal presentation of the information on 
rectangles and triangles. The formula for 
finding the area of each figure was given 
and the children were instructed to find the 
areas by means of it. Pupils were given the 
terms base and altitude without any objective 
helps as to their meaning. No suggestions 
were made regarding the fact that common fig- 
ures and spaces are made up of rectangles and 
triangles. Verbal problems dealing with ab- 
stract situations were used as practice ma- 
terial in this method of study. 
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Method B is based upon an objective pre- 
sentation of the information on rectangles 
and triangles. The area of a rectangle is 
shown to be the number of squares formed in 
the figure when lines are drawn, one linear 
unit apart, both ways across the rectangle. 
A triangle is shown, by a pictorial method, 
to be one half of a rectangle whose dimen- 
sions are the same as those of the triangle. 
The problems used for practice in computing 
areas are verbal but employ rectangles and 
triangles in their natural settings in the 
child's environment. 

Method C is a variation of Method B.. The 
same method of presenting information is em 
ployed. The same instruction on finding the 
areas is given as in B. The practice work 
is, however, of two kinds: first, the pu- 
pils are given an opportunity to recognize 
rectangles and triangles in larger figures; 
second, pupils are requested to find areas of 
rectangles and triangles which are shown to 
be part of a larger figure. In some cases 
the words rectangle and triangle are not used 
in connection with the picture. The problems 
are not of the verbal type but refer to the 
common figures and spaces in the child's en- 
vironment as do the problems in method B. 

A pretest of four parts was given to all 
pupils before the study mterial employed in 
this investigation was presented. This test 
aims only to determine the amount of infor- 
mation concerning rectangles and triangles 
possessed by the pupils and their ability to 
handle the forms in problems. The test does 
not aim to measure general mathematical abil- 
ity. Part I of the test calls for general 
information about rectangles and triangles. 
It is almost entirely of the completion type. 
Most of the blanks to be filled do not per- 
mit of any variation in response. Part II of 
the test is composed of verbal problems on 
rectangles and triangles. They ere of the 
same type as those used in practice in meth- 
od A. Part III of the test is made up of 
verbal problems which deal with real situa- 
tions, They are the same as those used inthe 
method B practice material. Part IV of the 
test includes a series of picture problems 
which correspond with the practice material 
of method C. An illustration of each type of 
problem is given below: 
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Method A problem: "2. A rectangle is 18 
feet long and 14 feet wide. Find the area 
of the rectangle. ..... 5. Find the area of 
a triangle that has a base of 164 rods and 
an altitude of 12 rods," 

Method B problems: "2, The dimensions of 
a window are 3 feet and 6 feet. What is the 
area of the window? ..... 5. An odd shaped 
piece of land is divided into two triangles. 
Each triangle has a base of 15 rods. One has 
an altitude of 12 rods, the other an altitude 
of 8 rods. What is the area of the piece 
of land?" 

Method C problems: "2. The figure repre- 

sents the end of a garage. 
What is the area of the larg- 
est rectangle you can draw in 





iM 
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Find the area of this figure." 

The scoring of the test requires some ex- 
planation. Problems of this sort are usual- 
ly considered correct only when the correct 
answer is obtdined. A correct answer is, 
however, no guarantee that the pupil has used 
the correct reasoning in obtaining it. Some 
of the test papers show that correct answers 
were ot'tained by very faulty operations, 
Since this investigation does not have to do 
with general mathematical ability, it ap- 
peared to the writer that the scores made on 
the test should not be influenced by the lack 
of the mastery of the fundamental operations 
or by mistakes in performance due to nervous- 
ness or careless habits. The scores should 
constitute an index of the pupil's ability to 
recognize the form and his knowledge of how 
to compute the areas, For this reason, Parts 
II, III and IV of the test were scored on the 
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basis of one point for each time the pupil 
used the correct operation in the problems. 

Two study periods were given the pupils. 
During the first period all pupils studied 
rectangles and in the second they all stud- 
{ed triangles. Every child in the roon, 
whether in a matched group or not, took part 
in the activity going on at the time. The 
pupils were instructed to gain as much in- 
formation as it was possible for them to do 
during the thirty minutes study period. The 
pupils were told that it was not necessary 
to finish the three pages of study material. 
The person in charge of the study periods 
gave no help to the pupils other than to 
make clear what was printed on the papers 
in their possession. 

A final test followed the study periods. 
The same test as that used in the pretest 
was given as the final test. In treating 
the data, it is assumed that gains in scores 
made on the different parts of the final 
test, over the pretest, may in some instan- 
ces be attributed to direct instruction and 








practice while in other instances the gains 
are attributed to transfer effect, depending 
upon the method of study used by the pupils 


making the gains, The test was given ata 
later date asaretention test to determine 
the effectiveness of the three methods of 
study with respect to retention. 

The reliability of the test was deter- 
mined by two different methods: the self- 
correlation method and the chance-halves 
method, In the first method the scores mde 
by the same pupils at two different times, 
under approximately the same conditions, 
were used as the basis of computation. The 
scores on the final test and the retention 
test were used for this purpose. The results 
are given in Table I. 


TABLE I 


COEFFICIENTS OF CORRELATION BETWEEN SCORES 
MADE ON THE FINAL wr nee TESTS BY SEVEN GROUPS 
PUPILS 





No. of cases P.E., 
+064 
024 
-030 
O21 
2019 
+010 
-004 


Grade 





Sixth grade 

Sixth grade 

Sixth and seventh 
Sixth and seventh 
Seventh 

Seventh 

Sixth and seventh 
(from the above groups) 
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The reliability of the test was also de- 
termined for two groups of pupils (first and 
sixth groups of Table I) by means of the 
chance-halves method. The scores on the odd 
and even numbered points of the final test 
were used in this method. A coefficient of 
reliability of .8923 + .023 was obtained for 
the sixth grade group of 36 pupils. The scores 
for the seventh grade group of 60 pupils 
yielded*a coefficient of reliability of .9549 
+ .008. 

Results 

In order to overcome such inequalities as 
may exist in the unit of measurement employed 
in this investigation the results for the in- 
vestigation have been presented in five dif- 
ferent ways: (1) the raw scores (Table II); 
(2) standard scores, transmuted on the basis 
of the pretest (Table III); (3) standard 
scores, transmuted on the basis of the final 
scores for the practice groups (Table IV); 
(4) the per cent of gain with the pretest as 
the base (Table V) and (5) the per cent of 
gain with the possible gain as the base (Ta- 
ble VI). 

The average gains on the final test over 
pretest are statistically significant for 
study groups on each part of the test. 

27 critical ratios given in Tables II, III 
IV range from 3.7 to 8.4, the three meth- 
of treating the scores giving practically 

the same results. The data given in Tables V 

and VI also appear to represent real zains, 

While the gains are statistically significant, 
in the absence of positive evidence to the 

contrary, there is the possibility that they 

may be due to practice effect froma second 
application of the test employed in the in- 
vestigation. 

In the absence of direct evidence as to 
the amount of practice effect, the gains made 
on the final test over the pretest were com- 
pared with the gains made on the retention 
test over the final test (Table VII). The 
gains made on the retention test over the fi- 
nal test are not due to instruction. Since 
the differences between the average gains on 
the final test over the pretest and the av- 
erage gains on the retention test over the 
final test are not, with one exception, sta- 
tistically significant, it would seem that 
the gains on the final test over the pretest 
may have been due to practice effect from 
the second application of the test rather 


the 
all 
The 
and 
ods 
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than to instruction. While this may be true 
‘tthe addition of a constant amount (practice 
effect) to all groups in no manner invali- 
dates the comparison of the results from one 
group to another insofar as these differences 
are statistically significant. 

A comparison of the amounts of transfer 
secured from the three methods is presented 
in Table VIII. While none of the differences 
are statistically significant, Method B 
proves to be superior to Method A in seven 
of the nine comparisons, two of the critical 
ratios being 2.2. In the two comparisons 
which do not favor Method B, the critical ra- 
tios are practically zero (.029 and .032). 
Method B is slightly superior to Method C 
and Method C is somewhat superior to Method A, 
The small differences between the several 
methods would seem to indicate that two thir- 
ty minute study periods were insufficient, 
the small gains from instruction being lost, 
for comparative purposes, in the practice ef- 
fect, resulting from two applications of the 
test. 

A more detailed analysis of the data brings 
out several points of interest. In the first 


place it will be noted that none of the meth- 
ods of study employed in this investigation 
seem to be effective in teaching pupils to 


solve problems of types III and IV. In gen- 
eral Method B is the most effective for all 
types of problems. On the final test the 
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transfer gains appear to be greater than the 
instructional gains, while on the retention 
test the practice groups exceed the transfer 
groups regardless of the method employed in 
Study. Whether this difference in gains may 
be the result of chance factors or whether it 
may be due to the short study period used in 
the investigation or some other cause the 
writer is unable to say. 


CONCLUSIONS 


1. Of the three methods of instruction 
studied in this investigation, Method B ap- 
pears to be superior to Methods A and C in 
teaching pupils to solve all types of prob- 
lems used in the investigation. The transfer 
effect for Method B appears to be greatest. 

2. None of the methods of study used in 
the investigation appear to be particularly 
effective in teaching pupils to solve prob- 
lems of types III and IV. 

3. The time allotted to study in the ine 
vestigation was probably not long enough to 
produce instructional gains and transfer 
gains sufficiently large, considering the 
large gains from the practice effect of two 
applications of two tests, to be considered 
statistically significant, 





JOURNAL OF EXPERIMENTAL EDUCATION 


TABLE II 


TABLE SHOWING TOTAL SCORES, AVERAGE SCORES, GAINS IN AVERAGE SCORE 
OVER PREVIOUS TEST, AND STATISTICAL SIGNIFICANCE OF GAINS 
(Critical Ratio computed on basis of probable error) 





Pretest Final Retention 
III III III 





of test 








476 548 
5.01 


Total score 
Average score 


Average gain over previ- 
ous test 

Statistical significance 
of gain (C.R.) 














Method A 











Total score 

Average score 

Average gain over previ- 
ous test 


Statistical significance 
of gain (C.R.) 














Method B 











Total score 

Average score 

Average gain over previ- 
ous test 

Statistical significance 
of gain 

















3 
5 
. 














TABLE III 


COMPARABLE SCORES, TRANSMUTED ON THE BASIS OF SCORES MADE ON THE PARTS OF THE PRETEST, 
SHOWING TOTAL SCORES, AVERAGE SCORES, GAINS IN AVERAGE SCORE OVER PREVIOUS TEST, 
AND STATISTICAL SIGNIFICANCE OF GAINS 





Pretest Final Retention 
of test Il III IV II III II III IV 


Total score 541 547.5 607 749.6 969 866.4 565.3 
Average score 5.69 5.76 8.49 7.89 9.12 5.95 


Gain in av. score over 
previous test 2.80 2.13 1.23 1.65 


Statistical significance 
of gain 

Total score 734 630.8 787.6 663 

Average score 7.75 6.64 8.29 6.99 


Gain in av. score over 
previous test 3.36 2.11 1.65 1.31 
Statistical significance 
of gain 7.6 4.8 J 3.7 2.9 


Total score 795 707.8 602.3 
Average score 8.37 7.45 8.52 6.34 


Gain in av. score over 
previous test 2.60 2.69 


Statistical significance 
of gain 5.9 6.1 4.8 2.7 2.4 3.9 


























6.3 4.8 2.8 3.7 





















































*wote.--The total and average scores of Table II were obtained by transmiting the scores of Table I 
into comparable scores on the basis of the scores made on the pretest by all the pupils. 








. 
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TABLE IV 









COMPARABLE SCORES, TRANSMUTED ON THE BASIS OF THE SCORES MADE ON PARTS II, III 
AND IV BY GROUPS A, B AND C, RESPECTIVELY, SHOWING TOTAL SCORES 

AVERAGE SCORES, GAIN IN AVERAGE SCORE OVER PREVIOUS TEST, AND THE STATISTICAL SIG- 

NIFICANCE OF THE GAIN. 

















Test Pretest Final Retention 
Part of test Il III IV II Ill IV II III IV 


























































~ |_Total score 541 626.6 296.8 | 607? 660.7 562.4 | 060 006.5 Tae.5 
Average score 5.69 6.59 3.93 8.49 9.06 5.92 10.2 10.49 7.73 
3 Gain in av. score over 
= previous test 2.80 2.47 1.99 1.71 1.43 1.83 
| Statistical significance 
of gain 5.3 4.7 3.8 2.9 2.7 3.5 
m | Total score 415 489.5 365.7 | 784 725 706.5 | 795 WS. tT SSEe 
Average score 4.37 5.15 4.06 7.75 7.60 7.44 : ; 737 
3 Gain in av. score over 
4 previous test 3.36 2.45 3.38 -67 1.93 1.53 
= Statistical significance 






of gain . 6.3 4.6 6.4 1.3 3.6 2.9 
































Total score 795 812.3 910 930 779 
© | Average score 5.77 5.41 3.66 8.37 8.55 6.18 9.58 9.79 8.20 
3S | Gain in av. score over 
$ previous test 2.60 3.14 2.52 1.21 1.24 2.02 
a Statistical significance 
of gain 4.9 5.9 4.8 2.3 2.3 3.8 

























*Note.--The total and average scores of Table IIl were obtained by transmuting the scores of Table I! 
into comparable scores on the basis of the scores made on Parts II, III and IV of the final test by 
Group A, Group B and Group C, respectively. 








TABLE V 


A TABLE SHOWING THE GAIN IN AVERAGE FINAL TEST SCORE OVER AVERAGE 
PRETEST SCORE, GAIN IN AVEHAGE RETENTION TEST SCORE OVER AVERAGE FINAL TEST SCORE, 
AND THE PER CENT THE GAIN IS OF THE POSSIBLE GAIN 














Method A Method B Method C 














Part of test II IIl IV II III IV Il III IV 
Av. final test score 8.49 5.01 1.08 7.73 4.24 1.44 8.37 4.74 1.16 


























Av. pretest score 5.69 3.70 -66 4.37 2.94 -69 5.77 3.08 -60 
__Average gain 2.80 1.31 242 3.36 1.30 75 2.60 1.66 - 56 
Possible gain 23.31 13.3 28.34 24.63 14.06 28.31 23.23 13.92 «40 ’ 




















v. retention test score | 10.5 5. T.51 740 | 5.06 | 1.76 | 0.00 | 5.40 
Av. final test score 8.49 §.01 1.08 7.73 4.24 1.44 8.37 4.74 
Average gain 1.71 -76 045 67 1.02 34 1.21 -66 45 
Possible gain 20.51 {11.99 {27.92 | 21.27 | 12.76 27.56 | 20.63 | 12.26 | 27.84 
Per cent possible gain 8.34% | 6.34% | 1.54%/ 3.14%) 7.99%| 1.23% | 5.86% | 5.36%) 1.62% 











28 

Per cent of possible gain | 12.00% | 9.85% | 1.46%] 13.63% 9.24%] 2.65% | 11.19% [11.92%] 1.974 
1.61 
1 
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TABLE VI 


A TABLE SHOWING AVERAGE SCORES, AVERAGE GAINS, AND THE PER CENT THE 
AVERAGE GAIN IS OF THE AVEHAGE PRETEST SCORE ON EACH PART OF THE TEST FOR EACH 
METHOD OF STUDY 









































































































































Method A Method B Method C 
Part of test ss Ir | IV Il III IV II III IV 
Av. score on final test 8.49 5.01 1.08 7.73 4.24 1.44 8.37 4.74 1.16 
Av. score on pretest 5.69 3.70 -66 4.37 2.94 .69 5.77 3.08 -60 
Average gain 2.60 | 1.51 42 3.36 1.30 275 2.60 1.66 -56 
“Per cent av. gain is of 
average pretest score 49.2% | 35.2% | 63.6% | 76.9% | 45.2% | 108% 47.9% | 53.9% | 94.9% 
AV. score on retention 
test 10.2 5.77 1.51 8.40 5.26 1.78 9.58 5.40 1.61 
Av. score on final test 8.49 5.01 1.08 7.75 4.24 1.44 8.37 4.74 1.16 
Average gain 1.71 76 «43 67 1.02 34 1.21 -66 +45 
Per cent average gain is 
of average pretest score | 30.05% | 20.54%/ 65.15%| 15.3% | 34.7% | 49.9% | 21.97% | 21.43% | 75.00% 
TABLE Vil 
COMPARISON OF THE AVERAGE GAINS ON FINAL TEST OVER PRETEST WITH THE 
AVERAGE GAINS ON RETENTION TEST OVEK FINAL TEST 
Part of test il III IV 
< | Av. gain, final over pretest 2.80 + .460 1.31 + .307 -42 + .092 
@ |_Av. gain, retention over final 1.71 + .592 -76 + .346 -43 + .140 
§ Difference in gain 1.09 55 -.01 
3 | P. £. of difference «75 +463 -168 
Critical Ratio a 1.45 1.19 06 
Part of test il III IV 
m | Av. gain, final over pretest 5.36 + .454 1.50 + .243 -75 + .116 
3 Av. gain, retention over final 67 + .582 1.02 + .292 34 + .190 
»% | Difference gain 2.69 -08 -41 
a | P. £. of difference 789 ~ 380 223 
7 Critical katio 3.64 -21 1.39 
Part of test It III IV 
© | Av. gain, final over pretest 2.60 + .472 1.66 + .267 56 + .093 
: Av. gain, retention over final 1.21 + .596 -66 + .316 -45 + .152 
Difference in gain 1.39 1.00 ell 
a [P.E. of difference ~760 -414 -178 
Critical Ratio 1.8 2.4 62 
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TABLE VIII 


A TABLE SHOWING THE DIFFERENCES BETWEEN AVERAGE GAINS MADE ON THE 
PARTS OF THE TEST BY THE STUDY GROUPS, THE PROBABLE ERRORS OF THE DIFFERENCES 
AND THE CRITICAL RATIOS 





Data from Table II Data from Table III Data from Table IV 








Final test over pretest 


Part of test 


Il 


Ill 


Iv 


Il 


Ill 


IV 


II 


III 


IV 





Av. gain Method A 


2.80 


1.31 


242 


2.80 


2.13 


1.62 


2.80 


2.47 


1.99 





Av. gain Method B 


1.30 


275 


3.36 


2.11 


2.88 


35.36 


2.45 


3.38 





Difference (A-B) 


-O1 


-.33 


-.56 


-02 


-1.26 


-02 


-1.39 





P. BE. of difference 


646 


-578 


-148 


-748 


+748 


748 


624 


-624 





Critical Ratio 


-.85 


029 





-.75 


-1.68 


032 


-2.2 








Av. gain Method A 


1.31 


242 


2.80 


1.62 


1.99 





Av. gain Method C 


1.66 


2.16 


2.52 





Difference (A-C) 


-.14 


+20 


~.54 


~.53 





P, E. of difference 


e131 


«748 


624 





Critical Ratio 


-1.07 


+27 


-.72 


-.88 








Av. gain Method B 


275 


2.88 





Av. gain Method C 


-56 


2.16 





Difference (B-C) 


-19 


+72 





P. E. of difference 


-748 








Critical Ratio 
































Retention test over final test 


Part of test 
Av. gain Method A 
v. 
Difference (A-B 
P. 

° 


Vv. 
v. 
Difference 


P. E. of difference 


Critical Ratio 
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COMPARISON OF TWO METHODS OF STUDYING HISTORY 
By John J. Dynes 
Western State College 


Gunnison, 


The problem of this investigation was to 
study the relative effectiveness of two study 
techniques in history. There were two dif- 
ferent phases to the problem. One phase was 
to discover if either technique was superior 
as judged from the amount of material learned 
in a given length of time. The second phase 
was to discover if either of-thetwo-study 
techniques was superior as judged from the 
amount of the learned material that was re- 
tained after a given length of time. A minor 
problem of the investigation was to find how 
pupils studied and to discover whether or not 
these study habivs influenced in any way the 
results obtained by the study techniques used 
in this investigation. 

The two study techniques used in this in- 
vestigation will be designated as Method X 
and Method Y. 

1. Method X: 

Read and reread the material, 

2. Method Y: 

(a) Give the mterial a rapid reading. 

(b) Reread the material, underline es- 
sential parts, take notes, 

(c) Review underlined portions and notes, 

(4) Write a brief summary of material 
read, 

(e) Recall what has been read. 

Investigations made of the study habits of 
pupils show that pupils waste time in school 
because they do not know how to study. There 
are many different sources of waste in the 
process of studying. Time may be wasted by 
Slow movements, by aimless work, by the lack 
of a definite objective, by not knowing what 
one is trying to do, or by the use of wrong 
methods of study, Many methods of study pre- 
vent the enjoyment of school, and want of en- 
joyment of school is likely to result in dis- 
taste for intellectual employment in general. 
McMurry states that; "Bad methods of study 





Colorado 


easily become a serious factor in adult life, 
acting as a barrier to one's growth and gen- 
eral usefulness," 

A survey of the investigations made on the 
study habits of pupils reveal a great igno- 
rance on the part of pupils of the whole sub- 
ject of study. It is evident that children 
are little acquainted with proper methods of 
study. These investigations show that pupils 
have little knowledge of the most economical 
methods of studying but through the use of 
trial-and-error methods hope in some way to 
attain the results desired by the teacher. 
Teachers themselves have very little definite, 
scientific knowledge of the relative values 
of different study techniques. Controlled ex- 
periments to determine the relative effec- 
tiveness of different methods of studying 
have not been widely undertaken. Investiga- 
tions have been made in the different fields 
of subject matter and on different academic 
levels, but comparatively few of the methods 
used in our schools have been tested scien- 
tifically to determine their value as teach- 
ing techniques, The relative values of dif- 
ferent methods used in teaching is not know 
although we find many different opinions ex- 
pressed regarding the particular methods that 
should be used in teaching the different sub- 
jects. Many teachers of history contend that 
the best method of teachine-ntstory IS that 
of taking notes while preparing the lesson, 
Other teachers contend that taking notes is a 
waste of time and that just as good results 
are obtained by the method of reading and re- 
reading the assigned material. This study 
was made in order to try to answer this ques- 
tion with reference to two study techniques 
in history. 

Four different high schools were used in 
the carrying on of this investigation. The 
pupils, 134 in number, from two high schools 


—— 
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were used for the purpose of standardizing 
the test material. The pupils, 144 in num 
ber, from the other two high schools were 
used in the major experiment to test the rel- 
ative value of the two study techniques, 

The material used in this investigation 
was selected from readings in social science 
for junior high school pupils. The two dif- 
ferent sets of material were of approximate- 
ly the same length and the content of the 
same general nature. The words were of about 
the same difficulty according to the Thorn- 
dike word list. A study habit check list 
was used in order to determine as objective- 
ly as possible how the pupils studied. A 
record was made of all the different activi- 
ties of each pupil during the period when he 
was studying. Objective tests were used to 
determine the amount of material learned and 
the amount retained. The tests consisted of 
true-false, multiple-choice and matching 
questions, 

An investigation of how pupils studied was 
first conducted, Each pupil was asked to 
study a selected piece of material by his 
own method of studying. After this was com 
pleted the major investigation was started, 
Each pupil was tested by both methods, X and 
Y. Half of the pupils first used Method X 
followed by Method Y, the other half of the 
pupils used Method Y first followed by Meth- 
od X. Two days intervened between the use 
of the two methods. The test for retention 
was given three weeks later in order to de- 
termine the amount of learning by the two 
methods, A test was given before studying, 
and again after studying the material. The 
difference in the scores was used to measure 
the amount learned during the study period. 
Thirty minutes were allowed for studying the 
material, and fifteen minutes for the pre- 
test and final test. 

The work was conducted on the individual 
plan, only one pupil being in the laboratory 
under the observation of the examiner during 
the study period, When the pupil entered the 
study room he was shown to his seat and the 
material with which he was to work placed on 
his desk. The examiner in charge of the ex- 
periment had an instruction sheet which he 
read with the pupil. The instruction sheet 
gave the directions for taking the tests, the 
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}8,52 (Table III, see following page); and 












time allowed for study, and the method of 
study to be used during the period, 

The two sets of study mterials used in 
the investigation materials were alternated 
in order to offset any carry-over from one 
method to the other, and to equalize if not 
eliminate practice effects. Material A was 
used half the time with Method X and half the 
time with Method Y, and Material B was used 
half the time with Metnod X and half the time 
with Method Y, 

An analysis of the data collected revealed 
the following facts: Pupils use the method 
of reading and rereading the material in 
preference to any other method; the rate of 
reading varies widely among high school pu- 
pils; pupils follow the technique of study 
suggested by the teacher when working in 
the study hall under supervision but when 
left to themselves will select the method 
that appeals to them individually. Only 33 
pupils out of 190 took notes when allowed to 
choose their own method of study, (Table I, 
see following page). Of these 33 pupils, 

16 did better work with Method X; 14 did bet- 
ter work with Method Y, and 3 pupils obtained 
the same results with both methods. This 
would seem to indicate that the study habits 
of the pupils had little or no effect upon 
the results obtained by the different meth- 
ods used in the major investigation. 

Tne data collected show that of the 144 
pupils who participated in the final experi- 
ments, 67 learned more with Method X, 73 with 
Method Y, and 4 pupils made equal gains with 
both methods. For retention Method X proved 
to be the better for 49 pupils, and Method Y ; 
was better for 76, while 9 pupils retained 
equal amounts with either metnod. The average ' 
score gained in school G with Method X was 
13.42 and the average score gained with Meth- 
od Y was 14.96. The difference in the mean 
improvement of Y over X was 1.54 points which 
is statistically significant. (Table II, see 
following page). The average score retained 
with Method X was 9.04 and the average score 
retained with Method Y was 10.08, The dif- 
ference in the average amount retained was 
1.04 points (Table II) and this amount is 
also statistically significant, In school H 
the average score gained with method X was 





































l. Only three tables chosen from the original data are here presented. 
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TABLE I 
SUMMARY OF THE DATA COLLECTED BY THE USE OF THE "STUDY HABIT 
C 


HECK LIST" 











Methods of Study 


School G (92 pupils) 


School H (52 pupils) 
































a 
. a k % % 
| Yes | No Yes No Yes No Yes No 
P l. Pupils went to work at once 92 100 52 100 
: 2. Rapid survey of work 10 | 62 ll er) 52 100 
¢ 3. Rapid survey of reading 92 100 52 100 
; 4. Intensive first reading! 
5. Times pupil read material® 
; 6. Re-read isolated parts 14 78 15 85 52 100 
at 7. Underline words, phrases 6 | 86 7 93 52 100 
ny 8. List words, dates, events 7 | 85 8 92 1 51 2 98 
Be 9. Take notes on material 7 | 8 8 92 4 48 8 92 
top 10. Outline material 8 | 84 9 91 3 49 6 34 
a ll. Written abstract or summary 92 100 52 100 
y 12. Use self devised questions 92 100 52 100 
Me 13. Study notes taken (85 took no notes) 5 2 71 29 3 1 75 25 
f 14. Use dictionary, maps, etc. 92 100 9 43 17 82 
4 15. Use “whole method" of study 84 8 91 9 46 6 88 12 
16. Use "part method" of study 8 | 84 9 91 6 46 12 88 
17. Use method of recall 9 | 83 10 90 5 47 10 90 
18. Concentrate on work 92 100 52 100 
19. Systematic in study habits 90 2 98 2 52 100 
20. Annoyed by work 92 100 52 1006 
21. Read and re-read, reg. method used 68 | 24 74 26 29 23 56 44 
22. Ordinarily took notes when studying 24 | 68 26 74 23 29 44 56 
23. Method used: read only 85 7 92 8 48 4 92 8 
24. Method used: read and took notes 7 | 8&5 8 92 4 48 8 92 





TABLE II 


(High School G) lange (6 to 15) 9 minutes. 
Fourteen pupils read the material only once; 78 read the whole or part of the 


material the second time. 


A SUMMARY OF THE SCORES MADE BY THE PUPILS 
USING THE TWO METHODS OF STUDY IN SCHOOL G 


Note:--(High School H) 1Range (6 to 22) 16 minutes. Average: 
&twenty-five pupils read the material only once; 27 read the whole or part of 


the material the second time. 


12.1 minutes. 


Average: 11.08 minutes. 


TABLE III 


A SUMMARY OF THE SCORES MADE BY THE PUPILS 
USING THE TWO METHODS OF STUDY IN SCHOOL H 



































(92 pupils) (52 pupils) 
Pretest Average | S.D. oy ee Pretest Average | &.D. cy a 
Method X: 36.72 9.03 4105 Method X;: 34.75 4.45 «1573 
Method Y: 36.14 9.27 4214 Method Y: 33.79 3.80 1343 
Fina] Test Final Test 
Method X: 50.14 6.87 3123 Method X: 43.27 5.92 2093 
Method Y: $1.10 7.71 3505 Method Y: 42.41 5.73 2026 
Points Gained Points Gained 
Method X: 13.42 8.97 4075 Method X: 8.52 5.76 2038 
wethod Y: 14.96 10.17 4634 1.54 Method Y: 8.62 5.23 -1493 10 
C.R., 4.186 C.R., .4746 
Retention Scores Retention Scores 
Method X: 45.76 6.88 «3127 Method X: 38.79 5.86 2072 
ie Method Ys 46.22 7.12 ~ 3236 Method Y: 39.12 5.12 -1810 
a ‘oints Retained Points Retained 
Bats. wethod X: 9.04 9.77 4438 Method X: 4.04 5.55 1684 
i, ethod Y: 10.08 9.82 «4447 1.04 Method Y: 5.33 4.95 e015 1.29 
y ’ CoRey 3.048 C.R., 4.92 
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the average score gained with method Y was 
8.62. The difference in the mean improve- 
ment of Y over X was +0.10. The average re- 
tention score for method X was 4,04; the av- 
erage retention score for method Y was 5.33. 
The difference in the average amount retained 
for Y over X was 1.29, and this amount is 
statistically significant. Three of the four 
comparisons thus favor method Y. 


CONCLUSIONS 


The results of this investigation in the 
light of the data obtained are presented in 
the form of answers to questions as follows: 

A. How do pupils study and what effect do 

the study habits of pupils have on the 

results obtained by the study tech- 
niques used in this investigation? 

1. Pupils use the whole method of 
studying. 

2. Pupils use the method of reading and 
rereading in preference to other 
methods, 

3. The method of study used in the reg- 
ular work in history appears to have 
little, if any effect upon the re- 
sults obtained from the methods used 
in this investigation. 





4. The preference for a given method af 
study appears to have little if any 
effect upon the results obtained 
when other methoidc are employed. 


B. What do the resuJts obtained from the 


investigation o? the relative effec- 

tiveness of the two different study 

techniques in history indicate? The 
data collected in this investigation 
would seem to justify the following 
conclusions: 

1. The method of taking notes, outlin- 
ing the material, summarizing the 
data, and reviewing, is slightly su- 
perior to the method of reading and 
rereading for immediate learning, 
both in the total amount learnedand 
the number of pupils who excelled 
by using this method, 

The method of taking notes, outlin- 
ing the material, summarizing the 
data, and reviewing the material, 
is superior to the method of read- 
ing and rereading for retention, 


both in the total amount retained 
and the number of pupils who ex- 
celled by using this method, 





